-- Logs begin at Wed 2022-08-03 18:00:01 UTC, end at Wed 2022-08-03 19:18:14 UTC. -- Aug 03 18:41:46.445825 dv-cinder-851640-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 18:41:46.457637 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 18:41:46 2022] *** Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: nodename: dv-cinder-851640-2-iscsi Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: machine: x86_64 Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: clock source: unix Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: pcre jit disabled Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: detected number of CPU cores: 4 Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: current working directory: / Aug 03 18:41:46.459597 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: detected binary path: /usr/bin/uwsgi-core Aug 03 18:41:46.460315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: your processes number limit is 47680 Aug 03 18:41:46.460315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: your memory page size is 4096 bytes Aug 03 18:41:46.460315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: detected max file descriptor number: 2048 Aug 03 18:41:46.460315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: lock engine: pthread robust mutexes Aug 03 18:41:46.460315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: thunder lock: enabled Aug 03 18:41:46.460315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 18:41:46.460315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 18:41:46.499414 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: Python main interpreter initialized at 0x5637d47b09c0 Aug 03 18:41:46.499414 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: python threads support enabled Aug 03 18:41:46.499414 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: your server socket listen backlog is limited to 100 connections Aug 03 18:41:46.499414 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: your mercy for graceful operations on workers is 90 seconds Aug 03 18:41:46.499808 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 18:41:46.499808 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: *** Operational MODE: preforking *** Aug 03 18:41:46.500091 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: *** uWSGI is running in multiple interpreter mode *** Aug 03 18:41:46.500091 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: spawned uWSGI master process (pid: 114854) Aug 03 18:41:46.500320 dv-cinder-851640-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 18:41:46.504315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: spawned uWSGI worker 1 (pid: 114855, cores: 1) Aug 03 18:41:46.504315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: spawned uWSGI worker 2 (pid: 114856, cores: 1) Aug 03 18:41:46.504315 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 18:41:47.173885 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 18:41:47.174511 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 18:41:48.270164 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:41:48.270164 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: from cryptography.utils import int_from_bytes Aug 03 18:41:48.270782 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:41:48.270782 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: from cryptography.utils import int_from_bytes Aug 03 18:41:48.271658 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:41:48.271658 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: from cryptography.utils import int_from_bytes Aug 03 18:41:48.272084 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:41:48.272084 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: from cryptography.utils import int_from_bytes Aug 03 18:41:50.776191 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 18:41:50.776792 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 18:41:50.777000 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 18:41:50.777311 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 18:41:50.777677 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 18:41:50.777764 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 18:41:50.777846 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 18:41:50.777979 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.778095 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 18:41:50.778305 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.778463 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 18:41:50.778628 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.779238 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 18:41:50.779575 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.779725 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.779951 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.780179 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.780462 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.780566 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.780662 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.780856 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.780953 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.781187 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.781285 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.781450 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.781537 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.781767 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.781854 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.782094 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-2-iscsi {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.782190 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.782420 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.782513 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.782694 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.782788 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.783017 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.783105 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.783335 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.783428 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-2-iscsi {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.783641 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.783734 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.783956 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.784041 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.784261 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.784380 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.784609 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.784785 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.784923 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.785221 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.785318 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.785531 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.785625 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.785843 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.786205 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.786351 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.786454 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.786591 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.786689 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.786771 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.786947 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.787086 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.787287 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.787380 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.787607 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.787710 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.787920 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.788018 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.788245 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.788416 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-2-iscsi {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.788583 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.788740 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.788914 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.789053 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.789227 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.789369 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.789645 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-2-iscsi {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.789785 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.789950 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.790099 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.790258 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.790410 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.790577 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.790714 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.791001 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.791089 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.791315 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.791411 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.791625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.791713 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.791948 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.792042 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.792274 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.792398 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.792606 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.792700 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.792908 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.793000 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.793219 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.793318 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.793528 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.793616 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.793846 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.793938 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.794150 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.794245 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.794545 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.795194 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.795345 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.795501 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.795757 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.795854 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.796070 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.796171 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.796411 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.796602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.796708 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.796795 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.797005 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.797153 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.797299 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.797454 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.797591 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.797737 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.797885 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.798081 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.798217 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.798362 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.798499 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.798634 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.798798 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.798929 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.799082 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.799223 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.799368 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.799519 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.799653 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.799830 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.799930 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.800094 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.800231 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.800430 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.800577 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.800742 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.800895 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.801058 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.801219 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.801369 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.801529 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.801681 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.801851 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.802007 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.802257 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.802364 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.802509 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.802617 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.802821 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.802918 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.803163 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.803260 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.803502 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.803625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.803797 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.803890 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.804116 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.804202 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.804463 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.804576 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.804774 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.804862 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.805083 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.805170 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.805391 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.805481 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.805712 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.805798 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806035 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806168 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806333 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806416 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806580 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806689 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806884 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.806973 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.807191 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.807282 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.807509 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.807600 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.807792 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.807879 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.808097 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.808187 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.808428 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.808518 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.808734 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.808822 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.809043 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.809143 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.809348 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.809442 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.809652 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.809752 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.809993 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.810088 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.810371 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.810469 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.810684 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.810783 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.810996 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.811091 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.811345 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.811521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.811605 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.811695 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.811901 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.812003 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.812209 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.812330 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.812541 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.812642 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.812847 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.812939 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.813156 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.813262 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.813466 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.813564 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.813772 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.813858 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.814080 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.814168 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.814386 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.814481 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.814695 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.814790 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.815009 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.815103 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.815321 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.815438 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.815632 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.815779 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.815939 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.816078 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.816248 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.816372 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.816582 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.816684 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.816891 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.816989 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.817200 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.817288 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.817505 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.817598 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.817815 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.817901 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.818114 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.818200 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.818417 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.818510 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.818723 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.818818 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.819031 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.819119 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.819337 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.819429 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.819640 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.819726 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.819948 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.820057 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.820246 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.820363 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.820579 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.820684 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.820886 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.820983 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.821192 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.821296 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.821495 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.821592 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.821800 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.821887 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.822127 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.822221 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.822438 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.822545 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.822748 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.822837 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.823054 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.823143 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.823376 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:41:50.823474 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.823713 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.823801 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.824047 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.824143 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.824389 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.824493 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.824703 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.824791 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.825018 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.825106 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.825344 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.825449 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.825685 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.825796 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.825997 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.826086 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.826325 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.826683 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.826779 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.826869 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827003 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827109 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827239 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827340 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827554 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827663 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827876 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.827971 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.828195 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.828300 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.828549 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.828638 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.828867 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.828955 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.829186 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.829279 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.829506 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.829602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.829821 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.829919 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.830146 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.830241 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.830476 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.830576 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.830793 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.830949 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.831104 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.831191 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.831423 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.831509 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.831735 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.831833 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.832053 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.832141 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.832387 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.832481 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.832714 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.832822 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.833024 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.833112 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.833338 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.833435 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.833648 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.833737 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.833958 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.834045 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.834272 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.834368 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.834584 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.834686 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.834896 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.834985 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.835208 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.835302 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.835522 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.835612 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.835834 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.835927 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.836147 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.836235 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.836486 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.836622 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.836806 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.836895 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.837121 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.837218 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.837434 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.837530 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.837745 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.837832 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.838047 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.838146 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.838350 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.838438 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.838654 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.838742 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.838962 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.839057 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.839265 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.839354 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.839567 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.839655 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.839876 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.839987 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.840188 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.840280 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.840519 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.840608 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.840836 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.840924 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.841148 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.841752 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.842025 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.842179 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.842362 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.842622 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.842758 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.842939 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.843082 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.843258 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.843406 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.843567 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.843715 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.843874 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.844019 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.844185 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.844366 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.844528 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.844649 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.844832 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.844934 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.845157 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.845258 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.845462 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.845548 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.845839 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.845946 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.846080 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.846168 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.846384 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.846477 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.846693 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.846793 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.847002 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.847109 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.847313 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.847410 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.847626 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.847713 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.847941 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.848028 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.848253 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.848374 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.848603 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.848704 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.848919 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.849008 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.849224 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.849310 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.849548 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.849643 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.849874 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.849961 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.850183 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.850328 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.850486 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.850583 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.850798 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.850886 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.851103 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.851191 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.851409 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.851505 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.851713 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.851808 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.852017 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.852103 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.852339 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.852430 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.852644 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.852730 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.852948 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.853033 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.853250 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.853338 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.853551 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.853636 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.853854 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.853950 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.854159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.854261 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.854463 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.854550 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.854767 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.854854 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.855071 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.855158 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.855374 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.855468 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.855680 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.855780 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.855987 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.856086 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.856350 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.856440 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.856662 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.857521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.857521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.857747 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.857836 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.857917 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.858144 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.858595 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.858694 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.858784 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.858866 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.858945 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.859051 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.859240 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.859378 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.859555 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.859669 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.859870 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.859980 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.860192 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.860316 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.860531 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.860704 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.860854 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.861034 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.861170 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.861346 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.861492 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.861667 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.861804 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.861972 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.862131 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.862287 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.862445 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.862633 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.862766 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.862968 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.863057 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.863283 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.863371 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.863605 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.863692 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.863917 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.864026 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.864231 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.864435 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.864587 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.864761 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.864901 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.865074 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.865213 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.865392 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.865527 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.865705 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.865846 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.866023 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.866153 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.866337 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.866476 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.866648 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.866786 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.866967 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.867109 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.867280 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.867419 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.867602 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.867727 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.867917 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.868034 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.868241 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.868401 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.868577 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.868692 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.868897 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.869027 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.869204 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.869339 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.869520 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.869652 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.869856 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.869976 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.870191 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.870288 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.870505 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.870594 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.870819 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.870910 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.871143 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.871243 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.871453 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.871540 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.871761 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.871855 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.872075 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.872175 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.872404 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.872553 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.872855 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.873028 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.873194 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.873314 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.873465 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.873641 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.874037 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.874221 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.874348 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.874536 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.874657 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.874846 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.874972 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.875166 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.875298 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.875476 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.875612 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.875783 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.875935 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.876108 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.876261 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.876429 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.876577 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.876754 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.876885 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.877069 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.877228 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.877394 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.877507 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.877718 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.877844 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.878025 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.878122 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.878330 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.878417 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.878653 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.878740 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.878963 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.879051 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.879271 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.879366 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.879579 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.879722 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.879889 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.880023 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.880228 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.880390 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.880566 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.880719 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.880864 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.881002 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.881174 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.881312 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.881495 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.881646 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.881808 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.881944 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.882118 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.882261 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.882430 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.882574 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.882742 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.882880 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.883050 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.883195 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.883363 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.883522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.883661 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.883797 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.883975 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.884113 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.884335 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.884472 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.884610 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.884747 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.884910 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.885047 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.885223 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.885361 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.885531 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.885681 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.885847 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.886105 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.886246 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.886441 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.886575 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.886751 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.886890 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.887067 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.887285 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.887433 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.887629 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.887783 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.887972 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.888655 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.888830 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.889238 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.889351 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.889465 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.889571 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.889788 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.889898 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.890125 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.890222 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.890456 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.890552 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.890763 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.890873 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.891074 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.891183 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.891383 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.891472 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.891687 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.891781 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.891989 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.892079 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.892320 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.892412 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.892618 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.892706 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.892923 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.893011 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.893229 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.893318 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.893532 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.893619 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.893834 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.893922 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.894138 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.894227 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.894440 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.894526 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.894741 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.894829 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.895055 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.895142 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.895361 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.895458 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.895663 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.895751 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.895968 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.896054 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.896272 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.896399 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.896614 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.896712 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.896918 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.897007 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.897226 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.897337 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.897528 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.897626 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.897874 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.897978 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.898184 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.898299 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.898485 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.898573 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.898811 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.898901 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.899119 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.899209 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.899427 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.899516 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.899731 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.899819 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.900046 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.900136 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.900380 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.900545 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.900689 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.900838 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.900988 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.901124 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.901261 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.901397 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.901570 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.901708 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.901875 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.902008 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.902176 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.902330 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.902487 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.902633 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.902790 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.902925 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.903097 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.903232 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.903401 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.903541 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.903789 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.904475 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.904633 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.904778 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.904910 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.905325 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.905469 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.905653 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.906071 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.906420 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.906587 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.906754 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.906903 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.907352 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.907642 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.907836 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.907937 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908020 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908101 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908199 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908309 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908407 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908501 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908583 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908670 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908758 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908840 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.908920 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909009 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909098 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909179 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909267 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909349 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909553 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909665 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909859 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.909949 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.910169 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.910335 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.910479 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.910613 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.910758 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.910913 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.911068 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.911218 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.911368 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.911551 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.911741 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.911885 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.912028 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.912168 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.912413 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.912560 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.912701 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.912838 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.912997 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.913138 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.913286 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.913426 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.913573 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.913712 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.913850 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.914001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.914142 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.914288 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.914434 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.914574 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.914724 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.914877 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.915026 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.915167 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.915307 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.915452 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.915593 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.915741 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.915888 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.916028 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.916163 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.916315 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.916450 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.916635 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.916768 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.916979 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.917079 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.917167 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.917364 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.917499 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.917666 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.917754 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.918025 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.918112 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.918333 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.918427 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.918652 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.918739 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.918966 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.919052 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.919280 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.919405 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.919627 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.919770 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.919931 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.920047 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.920239 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.920375 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.920578 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.920691 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.920889 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.920978 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.921190 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.921279 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.921495 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.921596 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.921798 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.921894 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.922120 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.922207 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.922432 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.922526 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.922744 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.922841 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.923064 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.923152 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.923386 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.923479 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.923697 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.923796 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.924004 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.924091 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.924334 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.924425 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.924647 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.924748 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.924955 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.925042 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.925263 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.925348 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.925572 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.925660 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.925885 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.925973 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.926194 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.926282 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.926505 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.926593 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.926815 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.926901 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.927120 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.927206 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.927424 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.927511 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.927732 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.927822 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.928037 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.928132 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.928363 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.928541 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.928717 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.928866 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.929011 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.929165 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.929317 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.929460 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.929610 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.929845 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.929995 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.930148 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.930292 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.930433 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.930573 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.930731 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.930875 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.931024 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.931173 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.931321 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.931463 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.931694 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.931839 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.931990 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.932132 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.932272 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.932467 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.932627 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.932782 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.932925 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.933574 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.933669 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.933669 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.933837 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.933922 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934003 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934084 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934164 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934280 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934386 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934581 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934669 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.934885 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.935015 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.935223 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.935507 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.935606 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.935836 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.935996 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.936129 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.936233 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.936457 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.936549 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.936773 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.936885 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.937079 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.937190 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.937399 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.937489 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.937707 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.937807 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.938030 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.938129 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.938407 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.938502 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.938749 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.938837 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.939056 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.939155 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.939420 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.939515 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.939743 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.939847 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.940068 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.940169 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.940412 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.940504 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.940716 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.940804 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.941033 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.941146 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.941345 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.941435 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.941678 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.941821 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.941975 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.942065 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.942283 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.942372 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.942597 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.942686 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.942900 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.942995 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.943216 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.943313 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.943524 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.943613 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.943841 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.943928 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.944162 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.944258 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.944501 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.944620 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.944825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.944947 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.945239 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.945329 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.945567 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.945666 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.945881 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.945979 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.946182 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.946277 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.946486 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.946582 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.946799 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.946897 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.947160 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.947261 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.947405 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.947492 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.947708 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.947870 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.948015 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.948105 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.948345 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.948448 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.948658 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.948755 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.948967 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.949054 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.949273 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.949362 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.949578 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.949668 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.949882 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.949969 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.950191 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.950299 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.950509 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.951120 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.951441 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.951654 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.951883 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.952066 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.952310 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.952462 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.952832 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.952991 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.953180 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.953503 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.953628 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.953815 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.953933 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.954138 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.954405 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.954525 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.954724 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.954819 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.955079 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.955223 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.955403 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.955587 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.955734 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.955952 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.956067 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.956399 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.956509 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.956774 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.956875 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.957051 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.957141 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.957370 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.957486 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.957691 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.957784 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.958020 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.958108 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.958325 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.958427 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.958631 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.958721 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.958943 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.959031 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.959248 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.959346 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.959554 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.959643 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.959860 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.959949 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.960188 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.960355 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.960501 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.960600 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.960807 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.960896 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.961111 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.961201 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.961432 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.961521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.961735 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.961823 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.962039 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.962133 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.962349 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.962439 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.962651 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.962746 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.962958 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.963048 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.963260 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.963349 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.963581 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.963685 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.963894 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.963984 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.964203 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.964355 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.964537 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.964646 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.964845 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.964944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.965169 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.965257 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.965491 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.965988 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.965988 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.966161 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.966293 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.966401 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.967114 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.967270 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.967434 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.967660 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.967823 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.968047 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.968149 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.968391 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.968491 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.968711 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.968799 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.969034 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.969135 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.969354 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.969605 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.969696 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.969940 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.970028 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.970259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.970364 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.970579 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.970676 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.970894 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.970984 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.971214 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.971450 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.971545 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.971787 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.971890 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.972112 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.972318 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.972463 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.972603 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.972762 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.972905 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.973082 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.973224 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.973402 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.973560 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.973719 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.973861 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.974036 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.974178 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.974353 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.974492 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.974668 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.974818 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.974985 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.975132 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.975304 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.975452 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.975630 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.975788 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.975966 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.976112 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.976276 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.976436 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.976616 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.976709 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.976931 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.977020 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.977245 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.977334 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.977618 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.977730 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.977869 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.977959 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.978187 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.978288 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.978500 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.978599 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.978811 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.978902 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.979122 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.979221 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.979436 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.979524 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.979748 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.979837 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.980063 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.980164 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.980416 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.980556 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.980722 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.980812 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.981034 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.981136 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.981347 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.981442 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.981663 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.981753 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.982018 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.982228 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.982359 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.982685 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.982773 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.983003 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.983172 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.983321 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.983412 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.983643 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.983732 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.983967 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.984165 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.984303 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.984509 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.984642 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.984848 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.984939 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.985177 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.985268 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.985505 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.985602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.985826 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.985925 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.986128 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.986224 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.986455 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.986545 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.986762 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.986863 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.987067 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.987155 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.987379 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.987468 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.987687 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.987795 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.987989 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.988229 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.988371 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.988627 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.988719 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.988934 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.989023 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.989258 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.989346 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.989571 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.989669 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.989890 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.990110 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.990199 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.990462 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.990573 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.990784 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.990886 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.991101 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.991188 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.991419 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.991516 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.991732 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.991842 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.992038 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.992126 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.992368 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.992534 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.992690 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.993406 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.993406 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.993809 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.993809 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.993973 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994057 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994138 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994218 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994297 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994297 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994461 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994461 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994608 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994758 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.994849 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.995061 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.995161 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.995372 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.995467 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.995676 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.995771 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.995976 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.996072 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.996281 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.996433 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.996611 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.996708 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.996916 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.997005 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.997218 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.997312 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.997548 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.997639 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.997857 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.998015 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.998364 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.998472 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.998654 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.999127 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.999230 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.999532 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:50.999847 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.000125 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.000336 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.000472 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.000823 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.001143 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.001422 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.001512 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.001743 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.001841 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.002074 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.002166 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.002385 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.002516 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.002723 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.002820 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.003054 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.003144 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.003367 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.003455 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.003683 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.003799 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.003999 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.004096 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.004332 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.004423 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.004690 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.004912 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.005003 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.005252 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.005541 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.005639 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.005880 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.005971 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.006204 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.006302 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.006526 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.006615 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.006833 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.006931 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.007142 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.007239 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.007456 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.007544 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.007768 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.007858 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.008079 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.008176 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.008417 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.008526 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.008731 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.008821 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.009042 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.009130 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.009350 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.009447 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.009664 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.009751 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.009973 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.010061 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.010302 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.010408 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.010593 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.010691 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.010903 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.011041 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.011212 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.011304 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.011521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.011611 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.011829 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.011918 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.012141 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.012234 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.012480 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.012611 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.012801 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.012891 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.013653 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.013823 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.014040 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.014162 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.014281 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.014492 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.014677 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.014812 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.014904 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.015135 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.015232 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.015451 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.015541 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.015765 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.015856 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.016077 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.016173 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.016420 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.016514 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.016734 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.016833 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.017064 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.017154 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.017382 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.017472 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.017689 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.017778 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.018084 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.018180 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.018399 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.018487 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.018724 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.018813 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.019048 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.019145 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.019360 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.019455 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.019683 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.019770 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.019994 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.020096 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.020339 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.020429 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.020670 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.020758 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.020987 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.021135 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.021312 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.021401 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.021618 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.021707 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.021925 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.022023 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.022230 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.022322 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.022540 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.022629 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.022861 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.022954 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.023166 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.023253 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.023467 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.023564 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.023771 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.023858 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.024080 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.024169 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.024411 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.024523 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.024714 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.024802 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.025020 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.025107 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.025323 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.025421 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.025629 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.025718 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.025930 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.026018 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.026280 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.026389 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.026538 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.026627 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.026838 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.026925 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.027140 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.027228 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.027442 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.027530 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.027743 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.027830 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.028044 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.028133 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.028372 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.028468 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.028678 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.028828 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.029630 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.029731 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.029941 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.030073 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.030272 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.030366 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.030583 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.030673 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.030892 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.030992 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.031219 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.031319 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.031533 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.031630 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.031856 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.031944 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.032166 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.032263 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.032508 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.032601 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.032831 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.032930 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.033139 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.033236 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.033447 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.033535 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.033776 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.033879 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.034090 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.034199 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.034400 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.034498 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.034713 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.034802 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.035028 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.035124 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.035338 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.035427 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.035649 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.035737 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.035961 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.036049 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.036275 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.036391 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.036611 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.036698 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.036937 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.037026 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.037256 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.037343 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.037562 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.037658 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.037880 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.037968 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.038193 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.038296 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.038519 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.038627 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.038827 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.038916 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.039137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.039224 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.039448 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.039545 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.039761 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.039857 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.040071 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.040167 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.040408 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.040510 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.040721 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.040808 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.041033 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.041129 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.041350 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.041439 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.041663 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.041758 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.041981 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.042068 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.042302 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.042389 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.042612 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.042699 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.042940 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.043052 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.043263 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.043354 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.043575 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.043661 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.043907 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.044102 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.044247 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.044413 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.044675 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.044820 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.044982 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.045135 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.045339 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.045479 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.045642 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.045727 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.045879 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114856) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 18:41:51.046020 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.046274 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.046583 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:41:51.046829 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 18:41:51.200116 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO dbcounter [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Registered counter for database nova_api Aug 03 18:41:51.201115 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO dbcounter [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Registered counter for database nova_api Aug 03 18:41:51.222340 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_db.sqlalchemy.engines [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.225354 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_db.sqlalchemy.engines [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.229026 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writer thread running {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.231906 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writer thread running {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.286425 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.context [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb8cd58f-50d6-42f2-8d04-20e0e2c543f2(cell1) {{(pid=114855) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 18:41:51.288645 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.context [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb8cd58f-50d6-42f2-8d04-20e0e2c543f2(cell1) {{(pid=114856) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 18:41:51.290359 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_concurrency.lockutils [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:41:51.291962 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_concurrency.lockutils [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:41:51.292578 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:41:51.292903 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_concurrency.lockutils [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:41:51.294200 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:41:51.294912 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_concurrency.lockutils [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:41:51.295018 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:41:51.297035 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO dbcounter [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Registered counter for database nova_cell0 Aug 03 18:41:51.297170 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:41:51.299071 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO dbcounter [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Registered counter for database nova_cell0 Aug 03 18:41:51.302686 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO dbcounter [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Registered counter for database nova_cell1 Aug 03 18:41:51.304864 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO dbcounter [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Registered counter for database nova_cell1 Aug 03 18:41:51.311357 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_db.sqlalchemy.engines [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.314036 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_db.sqlalchemy.engines [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.314824 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_db.sqlalchemy.engines [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.318691 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_db.sqlalchemy.engines [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.321145 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writer thread running {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.321278 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writer thread running {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.329267 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writer thread running {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.463931 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writer thread running {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.472689 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO dbcounter [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Registered counter for database nova_cell0 Aug 03 18:41:51.474175 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO dbcounter [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Registered counter for database nova_cell0 Aug 03 18:41:51.481691 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_db.sqlalchemy.engines [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114856) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.484885 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG oslo_db.sqlalchemy.engines [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:41:51.486698 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writer thread running {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.489585 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writer thread running {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:41:51.833307 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: WARNING keystonemiddleware.auth_token [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:41:51.840603 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: WARNING keystonemiddleware.auth_token [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:41:51.851388 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: WARNING keystonemiddleware.auth_token [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:41:51.859230 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: WARNING keystonemiddleware.auth_token [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:41:52.190721 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: WARNING keystonemiddleware.auth_token [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:41:52.196718 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: WARNING keystonemiddleware.auth_token [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:41:52.202185 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637d47b09c0 pid: 114856 (default app) Aug 03 18:41:52.204273 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:41:52.205490 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001782 Aug 03 18:41:52.205908 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Wed Aug 3 18:41:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:41:52.209694 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: WARNING keystonemiddleware.auth_token [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:41:52.215657 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: WARNING keystonemiddleware.auth_token [None req-a449d2e7-6bdb-4784-bc00-c41e783c0920 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:41:52.221635 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637d47b09c0 pid: 114855 (default app) Aug 03 18:43:09.483081 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:09.484008 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 03 18:43:09.484989 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:09.497510 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writing DB stats nova_api:SELECT=3 {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:09.498639 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writing DB stats nova_cell1:SELECT=3 {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:09.499374 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writing DB stats nova_cell0:SELECT=3 {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:09.500219 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:10.519686 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-083a5403-4a18-461c-82ca-c792aa16ef72 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:10.560092 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-083a5403-4a18-461c-82ca-c792aa16ef72 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.065980 Aug 03 18:43:10.560783 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Aug 3 18:43:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:12.814503 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:12.815702 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-a41db810-62c5-4d42-92fa-9e19cb6db67a None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003032 Aug 03 18:43:12.816409 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:13.325121 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-a86ffbb9-223a-4873-abd4-ef0bc318b156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:13.346789 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:43:13.346789 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: warnings.warn(msg) Aug 03 18:43:13.382979 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-a86ffbb9-223a-4873-abd4-ef0bc318b156 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.560371 Aug 03 18:43:13.384541 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 18:43:13.398264 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_api:SELECT=3 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:13.399632 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_cell0:SELECT=3 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:13.400942 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_cell1:SELECT=3 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:13.403115 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:13.624453 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-c9547eeb-bb5e-4c3c-b5f6-e87558c6880e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:13.629054 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:43:13.629054 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: warnings.warn(msg) Aug 03 18:43:13.705195 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-c9547eeb-bb5e-4c3c-b5f6-e87558c6880e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.312374 Aug 03 18:43:13.709677 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Aug 3 18:43:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:16.064911 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-a86ffbb9-223a-4873-abd4-ef0bc318b156 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:16.066592 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-a86ffbb9-223a-4873-abd4-ef0bc318b156 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Aug 03 18:43:16.067006 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:16.766381 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-3746058b-8740-40eb-9f8c-ef20b46d5086 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:16.786060 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:43:16.786060 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: warnings.warn(msg) Aug 03 18:43:16.807995 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-3746058b-8740-40eb-9f8c-ef20b46d5086 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.734791 Aug 03 18:43:16.809171 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 18:43:16.822312 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-8bde3dd4-17da-403f-afe7-1b35b889a90d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:16.826792 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:43:16.826792 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: warnings.warn(msg) Aug 03 18:43:16.863303 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-8bde3dd4-17da-403f-afe7-1b35b889a90d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045084 Aug 03 18:43:16.864130 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Aug 3 18:43:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:19.267619 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-3746058b-8740-40eb-9f8c-ef20b46d5086 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:19.268649 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-3746058b-8740-40eb-9f8c-ef20b46d5086 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 03 18:43:19.269050 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:19.691974 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-be0ffc22-0c8b-42a1-955d-5aeab4a7f50d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "disk": 10}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:19.711643 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-be0ffc22-0c8b-42a1-955d-5aeab4a7f50d admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436764 Aug 03 18:43:19.712197 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:19.724688 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-05a81654-090d-4bc4-ae12-56a69ac2b07f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:19.750189 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-05a81654-090d-4bc4-ae12-56a69ac2b07f admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029236 Aug 03 18:43:19.750773 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Aug 3 18:43:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:22.017074 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-be0ffc22-0c8b-42a1-955d-5aeab4a7f50d admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:22.018010 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-be0ffc22-0c8b-42a1-955d-5aeab4a7f50d admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 03 18:43:22.018407 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:22.473891 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-f52e8a2e-dcd8-4b91-be6f-a0fc11db1718 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:22.500445 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-f52e8a2e-dcd8-4b91-be6f-a0fc11db1718 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476044 Aug 03 18:43:22.508145 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:22.514052 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-cb5424e9-90dd-412a-9c24-3654454729f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:22.539712 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-cb5424e9-90dd-412a-9c24-3654454729f2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030047 Aug 03 18:43:22.548030 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Aug 3 18:43:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:24.769008 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-f52e8a2e-dcd8-4b91-be6f-a0fc11db1718 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:24.770959 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-f52e8a2e-dcd8-4b91-be6f-a0fc11db1718 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 Aug 03 18:43:24.771353 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:25.205592 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-e1f0924a-42f7-4752-a97b-855530010765 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "disk": 20}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:25.226443 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-e1f0924a-42f7-4752-a97b-855530010765 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448543 Aug 03 18:43:25.228502 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:25.241299 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-463d4c7c-1a2d-465e-bedd-e21970785e66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:25.270694 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-463d4c7c-1a2d-465e-bedd-e21970785e66 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034278 Aug 03 18:43:25.271550 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Wed Aug 3 18:43:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:43:27.551718 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-e1f0924a-42f7-4752-a97b-855530010765 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:27.553530 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-e1f0924a-42f7-4752-a97b-855530010765 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002352 Aug 03 18:43:27.554156 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:28.047085 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-6d1cdd41-2b00-44d5-b985-1fda1a4c5d46 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:28.071497 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-6d1cdd41-2b00-44d5-b985-1fda1a4c5d46 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.510324 Aug 03 18:43:28.072039 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Aug 3 18:43:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:43:30.645845 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-e1f0924a-42f7-4752-a97b-855530010765 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:30.646864 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-e1f0924a-42f7-4752-a97b-855530010765 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 03 18:43:30.647268 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:31.111787 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-b32dd60c-eb6e-407b-9eff-916672cc2075 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "ram": 512}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:31.134726 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-b32dd60c-eb6e-407b-9eff-916672cc2075 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.480475 Aug 03 18:43:31.135307 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:31.147342 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-145951df-2afe-4a5e-bf3e-418d69e1d2cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:31.172924 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-145951df-2afe-4a5e-bf3e-418d69e1d2cb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029176 Aug 03 18:43:31.173509 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Aug 3 18:43:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:33.437201 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-b32dd60c-eb6e-407b-9eff-916672cc2075 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:33.438218 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-b32dd60c-eb6e-407b-9eff-916672cc2075 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 03 18:43:33.438620 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:33.844137 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-f463f593-0e38-46b1-a4a5-2c5884d2bc15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:33.863008 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-f463f593-0e38-46b1-a4a5-2c5884d2bc15 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418242 Aug 03 18:43:33.863477 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:33.876987 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-ed8d5b98-1958-40bf-9928-0b4b9f18fed3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:33.903521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-ed8d5b98-1958-40bf-9928-0b4b9f18fed3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030821 Aug 03 18:43:33.904456 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Aug 3 18:43:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:36.133141 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-f463f593-0e38-46b1-a4a5-2c5884d2bc15 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:36.134146 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-f463f593-0e38-46b1-a4a5-2c5884d2bc15 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 03 18:43:36.134596 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:36.554995 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-9a3f2e3c-16ee-4eb6-8bbd-4feac5350b3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "swap": 0, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:36.576005 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-9a3f2e3c-16ee-4eb6-8bbd-4feac5350b3b admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.434855 Aug 03 18:43:36.577046 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:36.592486 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-23b11da2-8cd6-4466-89bf-0f2c103d21f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:36.621252 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-23b11da2-8cd6-4466-89bf-0f2c103d21f8 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032945 Aug 03 18:43:36.622635 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Aug 3 18:43:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:38.879600 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-9a3f2e3c-16ee-4eb6-8bbd-4feac5350b3b admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:38.881541 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-9a3f2e3c-16ee-4eb6-8bbd-4feac5350b3b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002264 Aug 03 18:43:38.882178 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:39.357446 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-d584db4e-ad92-4282-a3e1-5a1045d81a20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "ram": 8192, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:39.382170 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-d584db4e-ad92-4282-a3e1-5a1045d81a20 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.493058 Aug 03 18:43:39.383086 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:39.396143 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-9ce0353a-ad8a-48ea-ba6a-b73022d2c0a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:39.427857 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-9ce0353a-ad8a-48ea-ba6a-b73022d2c0a4 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035306 Aug 03 18:43:39.428818 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Aug 3 18:43:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:43:41.724563 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-d584db4e-ad92-4282-a3e1-5a1045d81a20 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:43:41.725958 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-d584db4e-ad92-4282-a3e1-5a1045d81a20 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001884 Aug 03 18:43:41.726434 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:43:42.197944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-a2e18169-ea34-4ea0-8ab1-9fe32b9010f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:42.223824 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-a2e18169-ea34-4ea0-8ab1-9fe32b9010f2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.490120 Aug 03 18:43:42.224788 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Wed Aug 3 18:43:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:43:42.239507 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-8c3fc020-1ea2-4737-97f4-59607e4155bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:43:42.245107 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:43:42.271089 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-8c3fc020-1ea2-4737-97f4-59607e4155bc admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037764 Aug 03 18:43:42.272116 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Wed Aug 3 18:43:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:44:02.028836 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-a2e18169-ea34-4ea0-8ab1-9fe32b9010f2 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:02.029844 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-a2e18169-ea34-4ea0-8ab1-9fe32b9010f2 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 03 18:44:02.030248 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:02.040632 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:44:02.428657 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-be2df5a9-845e-4a06-be08-73cb440c9130 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:02.446586 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-be2df5a9-845e-4a06-be08-73cb440c9130 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410427 Aug 03 18:44:02.447050 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Aug 3 18:44:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:44:03.532036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-a2e18169-ea34-4ea0-8ab1-9fe32b9010f2 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:03.533102 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-a2e18169-ea34-4ea0-8ab1-9fe32b9010f2 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 03 18:44:03.533504 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:04.073304 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-3d3d8fa3-598d-4505-93d9-25c3de2668d4 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:04.079489 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.wsgi [None req-3d3d8fa3-598d-4505-93d9-25c3de2668d4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-3d3d8fa3-598d-4505-93d9-25c3de2668d4 admin admin] Request method failure captured: Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Accept: application/json Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Accept-Encoding: gzip, deflate Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Connection: keep-alive Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Content-Length: 0 Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Host: 10.222.0.69 Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Openstack-Api-Version: compute 2.90 Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Openstack-System-Scope: None Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: User-Agent: python-novaclient Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Auth-Token: gAAAAABi6sHzbPH0ckzmxSgXIj651_37S74Mq1k0rzPYr9Hi6IPgek4cjkcI5VPi_Mc2i5bv4xUpxPBgfdbOPdYBji9bemD4Fd1Jn7WXmV30QqkPYthv2JLAzLBeOkd_v_V0xJr9YY4yI29ztf8ykY3EyuB9R3FNKl8V87XwxTdh2NKb0zfgxsM Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Domain-Id: None Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Domain-Name: None Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Identity-Status: Confirmed Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Is-Admin-Project: True Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Domain-Id: default Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Domain-Name: Default Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Name: admin Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Role: admin,member,reader Aug 03 18:44:04.082728 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Roles: admin,member,reader Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_649429edefe44474b26fed9c93d5ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant: admin Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant-Name: admin Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User: admin Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Domain-Id: default Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Domain-Name: Default Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Id: b499f31220244d41877273ff02e31ae4 Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Name: admin Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: method: > Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: exception: Flavor 42 could not be found. Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: action_args: {'id': '42'} Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:44:04.084409 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:04.085482 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.086625 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-3d3d8fa3-598d-4505-93d9-25c3de2668d4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:44:04.087700 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-3d3d8fa3-598d-4505-93d9-25c3de2668d4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.409845 Aug 03 18:44:04.087700 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Aug 3 18:44:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:44:04.094107 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-16856656-5b4c-4e16-9684-37c4af26a0c7 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:04.098384 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:44:04.118421 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-16856656-5b4c-4e16-9684-37c4af26a0c7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027853 Aug 03 18:44:04.118961 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Aug 3 18:44:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:44:04.129783 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-4eddf2ab-5f2b-4e2d-a927-442acdb5aaa9 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:04.154051 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-4eddf2ab-5f2b-4e2d-a927-442acdb5aaa9 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027798 Aug 03 18:44:04.154626 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Aug 3 18:44:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:44:04.164364 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-e94cda6c-1028-4b70-81e2-9a9ccd6b38fc admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:04.172615 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.wsgi [None req-e94cda6c-1028-4b70-81e2-9a9ccd6b38fc admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-e94cda6c-1028-4b70-81e2-9a9ccd6b38fc admin admin] Request method failure captured: Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Accept: application/json Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Accept-Encoding: gzip, deflate Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Connection: keep-alive Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Content-Length: 0 Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Host: 10.222.0.69 Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Openstack-Api-Version: compute 2.90 Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Openstack-System-Scope: None Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: User-Agent: python-novaclient Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Auth-Token: gAAAAABi6sHzbPH0ckzmxSgXIj651_37S74Mq1k0rzPYr9Hi6IPgek4cjkcI5VPi_Mc2i5bv4xUpxPBgfdbOPdYBji9bemD4Fd1Jn7WXmV30QqkPYthv2JLAzLBeOkd_v_V0xJr9YY4yI29ztf8ykY3EyuB9R3FNKl8V87XwxTdh2NKb0zfgxsM Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Domain-Id: None Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Domain-Name: None Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Identity-Status: Confirmed Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Is-Admin-Project: True Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Domain-Id: default Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Domain-Name: Default Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Name: admin Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Role: admin,member,reader Aug 03 18:44:04.175944 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Roles: admin,member,reader Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_649429edefe44474b26fed9c93d5ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant: admin Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant-Name: admin Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User: admin Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Domain-Id: default Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Domain-Name: Default Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Id: b499f31220244d41877273ff02e31ae4 Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Name: admin Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: method: > Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: exception: Flavor 42 could not be found. Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: action_args: {'id': '42'} Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:44:04.177522 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:04.178602 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:04.180016 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-e94cda6c-1028-4b70-81e2-9a9ccd6b38fc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:44:04.181278 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-e94cda6c-1028-4b70-81e2-9a9ccd6b38fc admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016738 Aug 03 18:44:04.181278 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Aug 3 18:44:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 18:44:05.162538 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-4eddf2ab-5f2b-4e2d-a927-442acdb5aaa9 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:05.163565 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-4eddf2ab-5f2b-4e2d-a927-442acdb5aaa9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 03 18:44:05.163956 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:05.699986 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-92491c2e-2cf3-4778-91fd-57c6218c7b15 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:05.705465 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.wsgi [None req-92491c2e-2cf3-4778-91fd-57c6218c7b15 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-92491c2e-2cf3-4778-91fd-57c6218c7b15 admin admin] Request method failure captured: Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Accept: application/json Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Accept-Encoding: gzip, deflate Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Connection: keep-alive Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Content-Length: 0 Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Host: 10.222.0.69 Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Openstack-Api-Version: compute 2.90 Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Openstack-System-Scope: None Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: User-Agent: python-novaclient Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Auth-Token: gAAAAABi6sH1py1_mCN11D1jHFR3sIPJ5HmTEleuDIvjRsyY7Y2Ga8BMF3Z10nRMKOsQwQ96CIP74rQSxgjUpr9Iz2eCclmdxZaOAc3OF01pnwDvI1CQy1ircxTR8D1fsDtnmZyhgpc5QS1RxWSr2Q3y6E0E2N4GQ_xThOpyT29wSZTROouAmoA Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Domain-Id: None Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Domain-Name: None Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Identity-Status: Confirmed Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Is-Admin-Project: True Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Domain-Id: default Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Domain-Name: Default Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Name: admin Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Role: admin,member,reader Aug 03 18:44:05.707036 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Roles: admin,member,reader Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_649429edefe44474b26fed9c93d5ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant: admin Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant-Name: admin Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User: admin Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Domain-Id: default Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Domain-Name: Default Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Id: b499f31220244d41877273ff02e31ae4 Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Name: admin Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: method: > Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: exception: Flavor 84 could not be found. Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: action_args: {'id': '84'} Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:44:05.708604 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:05.709430 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.710496 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-92491c2e-2cf3-4778-91fd-57c6218c7b15 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:44:05.711521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-92491c2e-2cf3-4778-91fd-57c6218c7b15 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.403044 Aug 03 18:44:05.711521 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Aug 3 18:44:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:44:05.718867 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-3a7ba138-b1e4-4647-af74-96af91be23a1 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:05.734002 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-3a7ba138-b1e4-4647-af74-96af91be23a1 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019455 Aug 03 18:44:05.734527 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Aug 3 18:44:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:44:05.743956 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-043bb516-32f0-4888-b24d-823be61e5c91 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:05.759705 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-043bb516-32f0-4888-b24d-823be61e5c91 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019187 Aug 03 18:44:05.760229 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Aug 3 18:44:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:44:05.769623 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-f60df4f5-e1be-4e82-856a-4f5965741973 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:05.774867 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.wsgi [None req-f60df4f5-e1be-4e82-856a-4f5965741973 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-f60df4f5-e1be-4e82-856a-4f5965741973 admin admin] Request method failure captured: Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Accept: application/json Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Accept-Encoding: gzip, deflate Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Connection: keep-alive Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Content-Length: 0 Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Host: 10.222.0.69 Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Openstack-Api-Version: compute 2.90 Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Openstack-System-Scope: None Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: User-Agent: python-novaclient Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Auth-Token: gAAAAABi6sH1py1_mCN11D1jHFR3sIPJ5HmTEleuDIvjRsyY7Y2Ga8BMF3Z10nRMKOsQwQ96CIP74rQSxgjUpr9Iz2eCclmdxZaOAc3OF01pnwDvI1CQy1ircxTR8D1fsDtnmZyhgpc5QS1RxWSr2Q3y6E0E2N4GQ_xThOpyT29wSZTROouAmoA Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Domain-Id: None Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Domain-Name: None Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Identity-Status: Confirmed Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Is-Admin-Project: True Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Domain-Id: default Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Domain-Name: Default Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Name: admin Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Role: admin,member,reader Aug 03 18:44:05.776387 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Roles: admin,member,reader Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_649429edefe44474b26fed9c93d5ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant: admin Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant-Name: admin Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User: admin Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Domain-Id: default Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Domain-Name: Default Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Id: b499f31220244d41877273ff02e31ae4 Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Name: admin Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: method: > Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: exception: Flavor 84 could not be found. Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: action_args: {'id': '84'} Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:44:05.778300 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:05.779375 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:05.780825 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-f60df4f5-e1be-4e82-856a-4f5965741973 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:44:05.782324 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-f60df4f5-e1be-4e82-856a-4f5965741973 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011714 Aug 03 18:44:05.782324 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Wed Aug 3 18:44:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:44:06.783272 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-043bb516-32f0-4888-b24d-823be61e5c91 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:06.784429 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-043bb516-32f0-4888-b24d-823be61e5c91 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 03 18:44:06.784865 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:07.316476 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-a86869d4-bc1d-4afb-81a0-acfa5d4c78b0 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:07.322388 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.wsgi [None req-a86869d4-bc1d-4afb-81a0-acfa5d4c78b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-a86869d4-bc1d-4afb-81a0-acfa5d4c78b0 admin admin] Request method failure captured: Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Accept: application/json Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Accept-Encoding: gzip, deflate Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Connection: keep-alive Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Content-Length: 0 Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Host: 10.222.0.69 Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Openstack-Api-Version: compute 2.90 Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Openstack-System-Scope: None Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: User-Agent: python-novaclient Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Auth-Token: gAAAAABi6sH2iLIGkPITJ1eGsqtuP-Dl077i-9iV_d3rifQRBPz8zk2Y0nE-KH70bvhJUu6JdPPGkAQu7EYlbbIZ-PXtq_OfiLUA6AXM15l30fTSG8sgiIenBJcbHmdhLJP8W8wWHBZ0tiTLWAbFDI8xKH5GMMPLZj-AD-WsneXRDeObN39CtjQ Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Domain-Id: None Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Domain-Name: None Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Identity-Status: Confirmed Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Is-Admin-Project: True Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Domain-Id: default Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Domain-Name: Default Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Project-Name: admin Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Role: admin,member,reader Aug 03 18:44:07.324413 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Roles: admin,member,reader Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_649429edefe44474b26fed9c93d5ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant: admin Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-Tenant-Name: admin Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User: admin Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Domain-Id: default Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Domain-Name: Default Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Id: b499f31220244d41877273ff02e31ae4 Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: X-User-Name: admin Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: method: > Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: exception: Flavor 451 could not be found. Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: action_args: {'id': '451'} Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:44:07.326396 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:07.327697 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.329159 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-a86869d4-bc1d-4afb-81a0-acfa5d4c78b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:44:07.330491 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-a86869d4-bc1d-4afb-81a0-acfa5d4c78b0 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.403305 Aug 03 18:44:07.330491 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Aug 3 18:44:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:44:07.335695 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-e1d865de-f88f-4440-823e-f2faf08b0ebd admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:07.352060 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-e1d865de-f88f-4440-823e-f2faf08b0ebd admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019953 Aug 03 18:44:07.352643 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Aug 3 18:44:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:44:07.362739 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:07.379452 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020248 Aug 03 18:44:07.380005 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Wed Aug 3 18:44:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:44:07.392051 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-30ac321a-ec4f-40f4-b9a0-a1ccd315a7c7 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:07.397733 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.wsgi [None req-30ac321a-ec4f-40f4-b9a0-a1ccd315a7c7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-30ac321a-ec4f-40f4-b9a0-a1ccd315a7c7 admin admin] Request method failure captured: Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Accept: application/json Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Accept-Encoding: gzip, deflate Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Connection: keep-alive Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Content-Length: 0 Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Host: 10.222.0.69 Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Openstack-Api-Version: compute 2.90 Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Openstack-System-Scope: None Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: User-Agent: python-novaclient Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Auth-Token: gAAAAABi6sH2iLIGkPITJ1eGsqtuP-Dl077i-9iV_d3rifQRBPz8zk2Y0nE-KH70bvhJUu6JdPPGkAQu7EYlbbIZ-PXtq_OfiLUA6AXM15l30fTSG8sgiIenBJcbHmdhLJP8W8wWHBZ0tiTLWAbFDI8xKH5GMMPLZj-AD-WsneXRDeObN39CtjQ Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Domain-Id: None Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Domain-Name: None Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Identity-Status: Confirmed Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Is-Admin-Project: True Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Domain-Id: default Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Domain-Name: Default Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Project-Name: admin Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Role: admin,member,reader Aug 03 18:44:07.399259 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Roles: admin,member,reader Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_649429edefe44474b26fed9c93d5ec67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/649429edefe44474b26fed9c93d5ec67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant: admin Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant-Id: 649429edefe44474b26fed9c93d5ec67 Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-Tenant-Name: admin Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User: admin Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Domain-Id: default Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Domain-Name: Default Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Id: b499f31220244d41877273ff02e31ae4 Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: X-User-Name: admin Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: method: > Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: exception: Flavor 451 could not be found. Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: action_args: {'id': '451'} Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:44:07.401001 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:07.402682 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: ERROR nova.api.openstack.wsgi Aug 03 18:44:07.404137 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-30ac321a-ec4f-40f4-b9a0-a1ccd315a7c7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114856) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:44:07.405390 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-30ac321a-ec4f-40f4-b9a0-a1ccd315a7c7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014251 Aug 03 18:44:07.405390 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Aug 3 18:44:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 18:44:08.422464 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:08.423508 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 03 18:44:08.423902 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:08.954105 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-3e0aa1c5-e250-4c00-811d-24de9e159830 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:44:08.973202 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-3e0aa1c5-e250-4c00-811d-24de9e159830 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.411052 Aug 03 18:44:08.973740 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Aug 3 18:44:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:44:09.988926 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:09.989964 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 03 18:44:09.990346 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:10.523551 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-3bc79035-42ad-4128-8ce6-4c18313ba034 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:44:10.543002 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-3bc79035-42ad-4128-8ce6-4c18313ba034 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.413931 Aug 03 18:44:10.543655 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Aug 3 18:44:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:44:11.522783 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:11.523821 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 03 18:44:11.524245 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:12.077065 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-54db7c84-0532-42d6-8a6e-ab8c504cab64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:44:12.096366 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-54db7c84-0532-42d6-8a6e-ab8c504cab64 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.432989 Aug 03 18:44:12.097003 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Aug 3 18:44:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:44:13.069486 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:13.070494 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 03 18:44:13.070889 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:13.614408 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-1b3542d4-82a1-43a3-ac56-c44ca833fe7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:44:13.633419 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-1b3542d4-82a1-43a3-ac56-c44ca833fe7a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.420295 Aug 03 18:44:13.633961 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Wed Aug 3 18:44:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:44:14.638084 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:14.639093 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 03 18:44:14.639527 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:44:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:44:15.216409 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-3e595e59-444c-4fea-9d8c-f9fa6bf726db admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:44:15.236879 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-3e595e59-444c-4fea-9d8c-f9fa6bf726db admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.456891 Aug 03 18:44:15.237424 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Wed Aug 3 18:44:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:45:07.184472 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:45:07.185419 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-da8c92f0-0665-4bec-98dd-65de7c82044a admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 Aug 03 18:45:07.185822 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 930 bytes} [Wed Aug 3 18:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:45:07.196301 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:45:07.592964 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-b5db234b-6a02-484f-886a-c756a7936420 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:45:07.613902 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-b5db234b-6a02-484f-886a-c756a7936420 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422091 Aug 03 18:45:07.614442 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1291 bytes} [Wed Aug 3 18:45:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:45:07.635911 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG dbcounter [-] [114855] Writing DB stats nova_api:SELECT=14 {{(pid=114855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:45:07.639868 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-b1cb6e80-5c24-4da2-b57a-31252f364f5f admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:45:07.647628 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-b1cb6e80-5c24-4da2-b57a-31252f364f5f admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013241 Aug 03 18:45:07.648153 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1282 bytes} [Wed Aug 3 18:45:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:45:07.660847 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-45428455-ce92-4657-9bfb-68be88b6fd1c admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:45:07.669652 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-45428455-ce92-4657-9bfb-68be88b6fd1c admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012407 Aug 03 18:45:07.670171 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1285 bytes} [Wed Aug 3 18:45:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:45:07.681782 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:45:07.689942 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011719 Aug 03 18:45:07.690420 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1285 bytes} [Wed Aug 3 18:45:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:45:07.704868 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-83b0a989-69e2-4e23-893e-d20d6ac25263 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:45:07.712564 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-83b0a989-69e2-4e23-893e-d20d6ac25263 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011292 Aug 03 18:45:07.713083 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1282 bytes} [Wed Aug 3 18:45:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:48:15.798496 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:15.799512 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 03 18:48:15.799904 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:48:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:48:15.941343 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_api:SELECT=6 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:48:16.109324 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-eea02b69-d45a-4e8c-8c10-d5e62dd487a4 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:16.111688 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:48:16.111688 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: warnings.warn(msg) Aug 03 18:48:16.112964 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-eea02b69-d45a-4e8c-8c10-d5e62dd487a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:16.113408 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-eea02b69-d45a-4e8c-8c10-d5e62dd487a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:16.114193 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-eea02b69-d45a-4e8c-8c10-d5e62dd487a4 admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:16.114624 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-eea02b69-d45a-4e8c-8c10-d5e62dd487a4 admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:16.150241 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-eea02b69-d45a-4e8c-8c10-d5e62dd487a4 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.210289 Aug 03 18:48:16.150828 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Aug 3 18:48:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:48:16.985250 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:16.986260 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 03 18:48:16.986653 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:48:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:48:17.178607 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-f52ad192-da38-4625-8233-055d1d83276a admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:17.181389 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:48:17.181389 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: warnings.warn(msg) Aug 03 18:48:17.182579 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-f52ad192-da38-4625-8233-055d1d83276a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:17.183037 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-f52ad192-da38-4625-8233-055d1d83276a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:17.183809 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-f52ad192-da38-4625-8233-055d1d83276a admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:17.184233 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-f52ad192-da38-4625-8233-055d1d83276a admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:17.204121 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-f52ad192-da38-4625-8233-055d1d83276a admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078477 Aug 03 18:48:17.204714 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Aug 3 18:48:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 18:48:28.461537 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:28.461537 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 03 18:48:28.462217 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 36/73] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:48:28.608201 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_cell0:SELECT=4 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:48:28.608947 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_cell1:SELECT=4 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:48:28.609570 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG dbcounter [-] [114856] Writing DB stats nova_api:SELECT=8 {{(pid=114856) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:48:28.658759 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-4fe8736f-ddba-435e-aa73-c28f4e3d8420 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:28.661161 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:48:28.661161 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: warnings.warn(msg) Aug 03 18:48:28.662383 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-4fe8736f-ddba-435e-aa73-c28f4e3d8420 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:28.662828 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-4fe8736f-ddba-435e-aa73-c28f4e3d8420 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:28.663616 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-4fe8736f-ddba-435e-aa73-c28f4e3d8420 admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:28.664047 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-4fe8736f-ddba-435e-aa73-c28f4e3d8420 admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:28.689739 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-4fe8736f-ddba-435e-aa73-c28f4e3d8420 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086340 Aug 03 18:48:28.690224 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 38/74] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Aug 3 18:48:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:48:29.542752 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: DEBUG nova.api.openstack.wsgi [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] Calling method '>' {{(pid=114855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:29.543765 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: INFO nova.api.openstack.requestlog [None req-bdd4eea7-1afa-41b1-875e-ea3e75e48f52 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 03 18:48:29.544168 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: [pid: 114855|app: 0|req: 37/75] 10.222.0.69 () {56 vars in 1074 bytes} [Wed Aug 3 18:48:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:48:29.741159 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG nova.api.openstack.wsgi [None req-05221da0-e144-4af9-8a99-0063bfc19db1 admin admin] Calling method '>' {{(pid=114856) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:48:29.743612 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 18:48:29.743612 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: warnings.warn(msg) Aug 03 18:48:29.746354 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-05221da0-e144-4af9-8a99-0063bfc19db1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:29.746799 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-05221da0-e144-4af9-8a99-0063bfc19db1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:29.747801 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-05221da0-e144-4af9-8a99-0063bfc19db1 admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:48:29.748221 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: DEBUG oslo_concurrency.lockutils [None req-05221da0-e144-4af9-8a99-0063bfc19db1 admin admin] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114856) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:48:29.772546 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: INFO nova.api.openstack.requestlog [None req-05221da0-e144-4af9-8a99-0063bfc19db1 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088069 Aug 03 18:48:29.773212 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: [pid: 114856|app: 0|req: 39/76] 10.222.0.69 () {60 vars in 1193 bytes} [Wed Aug 3 18:48:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:49:27.602942 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: Wed Aug 3 18:49:27 2022 - graceful shutdown triggered... Aug 03 18:49:27.603072 dv-cinder-851640-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 18:49:27.604025 dv-cinder-851640-2-iscsi devstack@n-api.service[114855]: Gracefully killing worker 1 (pid: 114855)... Aug 03 18:49:27.604491 dv-cinder-851640-2-iscsi devstack@n-api.service[114856]: Gracefully killing worker 2 (pid: 114856)... Aug 03 18:49:28.604931 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: worker 1 buried after 1 seconds Aug 03 18:49:28.604931 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: worker 2 buried after 1 seconds Aug 03 18:49:28.605580 dv-cinder-851640-2-iscsi devstack@n-api.service[114854]: goodbye to uWSGI. Aug 03 18:49:28.606518 dv-cinder-851640-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 03 18:49:28.607104 dv-cinder-851640-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 18:49:28.609876 dv-cinder-851640-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 18:49:28.623458 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 18:49:28 2022] *** Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: nodename: dv-cinder-851640-2-iscsi Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: machine: x86_64 Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: clock source: unix Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: pcre jit disabled Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: detected number of CPU cores: 4 Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: current working directory: / Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: detected binary path: /usr/bin/uwsgi-core Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: your processes number limit is 47680 Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: your memory page size is 4096 bytes Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: detected max file descriptor number: 2048 Aug 03 18:49:28.625613 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: lock engine: pthread robust mutexes Aug 03 18:49:28.627129 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: thunder lock: enabled Aug 03 18:49:28.627129 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 18:49:28.627129 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 18:49:28.671217 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: Python main interpreter initialized at 0x55efb61369c0 Aug 03 18:49:28.671217 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: python threads support enabled Aug 03 18:49:28.671217 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: your server socket listen backlog is limited to 100 connections Aug 03 18:49:28.671217 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: your mercy for graceful operations on workers is 90 seconds Aug 03 18:49:28.671711 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 18:49:28.671711 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: *** Operational MODE: preforking *** Aug 03 18:49:28.671954 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: *** uWSGI is running in multiple interpreter mode *** Aug 03 18:49:28.671954 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: spawned uWSGI master process (pid: 129348) Aug 03 18:49:28.672158 dv-cinder-851640-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 18:49:28.672976 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: spawned uWSGI worker 1 (pid: 129368, cores: 1) Aug 03 18:49:28.673349 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: spawned uWSGI worker 2 (pid: 129369, cores: 1) Aug 03 18:49:28.673506 dv-cinder-851640-2-iscsi devstack@n-api.service[129348]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 18:49:29.342450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 18:49:29.350843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 18:49:30.516019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:49:30.516019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: from cryptography.utils import int_from_bytes Aug 03 18:49:30.517456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:49:30.517456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: from cryptography.utils import int_from_bytes Aug 03 18:49:30.535614 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:49:30.535614 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: from cryptography.utils import int_from_bytes Aug 03 18:49:30.536229 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 18:49:30.536229 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: from cryptography.utils import int_from_bytes Aug 03 18:49:32.991091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 18:49:32.991696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 18:49:32.991933 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 18:49:32.992249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 18:49:32.992562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 18:49:32.992920 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.993249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.993570 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.993887 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.994218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.994530 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.994850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.995348 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.995528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.995765 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.996078 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.996433 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-2-iscsi {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.996756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.997284 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.997600 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.997927 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.998234 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.998558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.998866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:32.999373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.002843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.003124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.003433 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.003870 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-2-iscsi {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.004480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.004803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.005108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.005535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.005848 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.006159 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.006491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.006812 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.007127 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.007453 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.007771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.008092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.008471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.008783 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.009102 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.009411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.009720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.010031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.010336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.010586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.010894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.011301 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.011644 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.011946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.012201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.012500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.012819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.013143 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.013451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.013758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.014067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.014377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.014679 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.014983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.015286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.015591 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.015917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.016384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.017199 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.017199 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.017541 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.017750 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.018007 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.018316 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.018662 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.018984 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.019293 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.019611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.019930 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.020239 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.020628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.021098 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.021422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.021887 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.022181 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.022436 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.022740 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.023044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.023374 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.023664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.023968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.024274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.024600 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.024907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.025212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.025516 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.025818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.026126 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.026432 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.026737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.027041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.027345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.027662 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.027982 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.028322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.028633 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.028942 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.029248 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.029601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.029874 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.030177 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.030497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.030812 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.031105 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.031422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.031726 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.032081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.032931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.032931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.033241 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.033398 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 18:49:33.033919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.034076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 18:49:33.034222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.034222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.034536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 18:49:33.034701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.034855 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 18:49:33.035016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.035163 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 18:49:33.035336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.035496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.035647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.035647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.036066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.036258 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.036448 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.036670 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.036828 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.036974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.037116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.037116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.037413 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.037579 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.037722 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.037864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.038006 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.038155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.038973 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.039136 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.039292 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.039445 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.039633 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.039786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851640-2-iscsi {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.039940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.040095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.040244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.040244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.040569 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.040999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.041163 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.041308 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.041463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.041607 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.041749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.041904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.042106 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.042253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.042407 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.042550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.042702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.042952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.043106 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.043256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.043407 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.043557 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.043709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.043852 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.043852 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.044139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.044307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.044612 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.044776 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.044927 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.045081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.045231 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.045380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.045529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.045686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.045836 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.045978 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.046130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.046272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.046422 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851640-2-iscsi {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.046571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.046715 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.046856 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.047005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.047155 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.047298 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.048019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.048370 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.049016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.049386 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.049565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.049711 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.049862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.050015 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.050158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.050308 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.050460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.050610 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.050760 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.051208 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.051208 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.051503 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.051647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.051801 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.051951 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.052146 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.052321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.052483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.052626 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.052775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.052924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.053075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.053218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.053373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.053515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.053675 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.053824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.053967 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.054117 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.054273 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.054415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.054565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.054717 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.054866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.055014 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.055172 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.055314 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.055460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.055617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.055762 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.055912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.056056 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.056198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.056389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.056544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.056701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.056843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.056993 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.057143 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.057295 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.057454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.057609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.057759 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.057908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.058057 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.058207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.058351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.058505 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.058673 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.059062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.059239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.059609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.059777 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.059936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.060086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.060256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.061016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.061376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.061540 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.061700 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.061852 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.062015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.062300 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.062452 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.062610 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.062773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.062916 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.063231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.065316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.065481 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.065637 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.065790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.065934 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.066077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.066219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.066362 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.066514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.066659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.066813 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.066961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.067104 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.067272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.067516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.067714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.067864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.068016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.068160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.068333 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.068494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.068637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.068781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.068965 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.069363 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.069806 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.069977 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.070122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.070122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.070408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.070551 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.070699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.070859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.071017 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.071172 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.071430 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.071685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.071849 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.072007 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.072158 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.072502 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.072654 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.072797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.073013 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.073186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.073330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.073480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.073622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.073775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.073917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.074069 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.074211 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.074364 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.074505 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.074647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.074870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.075023 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.075166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.075315 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.075457 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.075598 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.075763 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.075906 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.076049 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.076191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.076351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.076500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.076658 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.076801 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.076950 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.077105 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.077248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.077395 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.077545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.077702 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.077844 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.077995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.078144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.078287 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.078438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.078588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.078789 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.079665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.080025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.080178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.080357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.080532 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.080692 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.080835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.080977 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.081118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.081267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.081429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.081670 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.081910 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.082065 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.082211 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.082399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.082647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.082820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.082964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.083105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.083247 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.083396 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.083547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.083699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.083841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.083982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.084131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.084281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.084460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.084604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.084756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.084905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.085048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.085196 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.085352 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.085496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.085645 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.085794 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.085936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.086132 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 18:49:33.086306 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086391 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086818 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.086999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087094 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087277 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087443 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087810 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.087991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088080 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088177 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088644 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088825 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.088999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.089081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.089176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.089269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.089353 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.089443 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.089541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090266 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090596 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.090690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091565 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.091665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.092379 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.092525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.092525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.092525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.092787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.093118 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.093215 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.093382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.093547 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.093681 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.093989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.094188 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.094861 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.095157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.095623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.095732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.095827 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.096128 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.096230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.096476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.096766 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.096877 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.097091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.097372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.097470 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.097697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.097970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.098072 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.098302 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.098576 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.098667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.099200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.099308 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.099508 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.099904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.100226 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.100347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.100447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.100606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.100744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.101142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.101329 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.101658 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.101755 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.101974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.102242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.102344 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.102595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.102831 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.102931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.103229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.103427 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.103552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.103889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.104026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.104194 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.104530 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.104836 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.105140 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.105337 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.105431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.105737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.105931 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.106042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.106346 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.106549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.106649 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.106949 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.107143 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.107242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.107540 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.107741 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.107881 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.108142 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.108355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.108463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.108777 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.108952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.109081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.109402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.109569 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.109708 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111195 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111410 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111579 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111662 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.111949 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.112268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.112483 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.112641 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.112951 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.113052 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.113349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.113564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.113664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.113889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.114193 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.114299 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.114488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.114756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.114856 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.115092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.115381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.115483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.115697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.115969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.116062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.116379 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.116632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.116771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.116952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.117255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.117354 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.117565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.117870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.117963 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.118184 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.118455 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.118548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.118786 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.119042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.119143 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.119384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.119642 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.119733 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.119983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.120236 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.120370 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.120622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.120866 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.120970 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.121307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.121412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.121533 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.121838 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.122018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.122148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.122460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.122698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.122812 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.123073 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.123210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.123383 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.123690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.123806 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.123992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.124317 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.124414 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.124636 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.124909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.125000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.125235 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.125522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.125628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.125912 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.126313 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.126402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.126486 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.126787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.126880 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.127092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.127388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.127488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.127692 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.127996 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.128107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.128327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.128624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.128716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.128926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.129497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.129612 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.129819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.130113 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.130378 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.130625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.130727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.131043 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.131977 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132180 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132275 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132399 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.132947 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.133040 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.133171 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.133409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.133511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.133782 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.133999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.134102 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.134385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.134582 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.134701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.135011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.135169 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.135323 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.135627 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.135726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.135931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.136249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.136472 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.136719 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.136858 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.137028 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.137347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.137439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.137671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.138450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.138545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.138545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.138714 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.138800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.138891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.139181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.139286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.139487 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.139783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.140144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.140144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.140567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.140710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.140710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.140895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.141027 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.141419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.141894 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.142246 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.142347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.142434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.142434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.142665 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.142758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.143071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.143371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.143676 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.143988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.144204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.144419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.144645 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.144764 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.144917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.145290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.145384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.145656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.145893 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.145988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.146251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.146482 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.146576 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.146861 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.147076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.147170 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.147475 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.147659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.147780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.148171 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.148271 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.148535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.148786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.148878 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.149142 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.149384 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.149490 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.149735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.149992 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.150084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.150350 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.150668 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.150777 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.150947 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.151168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.151515 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.151619 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.151749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.151844 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.152263 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.152402 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.152618 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.152883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.153065 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.153368 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.153469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.153626 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.153720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.154025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.154257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.154359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.154601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.154805 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.154926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.155231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.155331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.155537 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.155789 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.155881 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.156147 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.156343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.156503 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.157323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.157471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.157666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.157809 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.158045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.158148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.158311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.158427 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.158636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.158742 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.158961 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.159066 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.159292 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.159396 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.159614 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.159729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.159950 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.160062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.160272 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.160391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.160638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.160747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.160962 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.161066 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.161293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.161463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.161696 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.161882 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.162046 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.162205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.162323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.162400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.162598 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.162706 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.162919 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.163014 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.163242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.163331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.163550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.163714 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.163858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.164005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.164156 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.164319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.164474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.164572 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.164780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.164874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.165085 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.165188 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.165407 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.165502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.165709 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.165818 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.166031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.166126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.166343 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.166438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.166648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.166742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.166968 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.167074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.167274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.167358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.167610 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.167714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.167896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.168030 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.168199 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.168311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.168527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.168622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.168832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.168934 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.169170 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.169259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.169474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.169564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.169791 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.169896 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.170108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.170204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.170435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.170532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.170747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.170906 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.171043 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.171183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.171357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.171497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.171671 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.171831 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.171995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.172139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.172342 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.173396 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.173396 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.173639 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.173885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174039 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174175 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174704 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174846 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.174980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.175118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.175259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.175555 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.175865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.175952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.176167 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.176269 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.176579 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.176933 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.177258 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.177579 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.177900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.178220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.178556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.178747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.178917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.179082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.179239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.179485 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.179656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.179820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.179977 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.180145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.180350 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.180526 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.180691 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.180846 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.181029 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.181202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.181373 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.181528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.181682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.181836 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.181991 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.182158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.182321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.182485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.182640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.182802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.182956 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.183117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.183284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.183447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.183602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.183757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.183937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.184191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.184389 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.184547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.184702 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.185036 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.185302 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.185622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.185782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.185937 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.186091 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.186417 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.186585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.186827 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.186997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.187164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.187328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.187483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.187645 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.187807 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.187961 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.188424 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.188599 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.188599 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.188986 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.189142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.189303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.189471 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.189641 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.189797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.189957 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.190112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.190274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.190437 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.190600 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.190755 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.190916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.191077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.191242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.191412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.191584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.191747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.191901 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.192054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.192207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.192410 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.192745 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.192994 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.193169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.193386 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.193559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.193728 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.193895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.194059 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.194238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.194238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.194563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.194734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.194889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.195050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.195204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.195357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.195520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.195676 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.195841 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.196002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.196156 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.196329 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.196502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.196667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.196823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.196978 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.197131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.197300 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.197461 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.197614 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.197769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.197932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.198086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.198253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.198409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.198577 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.198739 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.198908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.199077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.199239 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.199393 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.199556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.199710 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.199710 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.200034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.200189 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.200369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.200536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.200691 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.200860 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.201016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.201187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.201343 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.201504 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.201659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.201825 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.201991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.202146 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.202307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.202462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.202630 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.202793 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.202955 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.203110 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.203270 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.203424 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.203586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.203788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.203998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.204229 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.204656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.204816 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.204985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.205150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.205312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.205467 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.205620 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.205782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.205946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.206108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.206272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.206447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.206610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.206773 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.206928 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.207082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.207244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.207399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.207552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.207721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.207876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.208031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.208185 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.208367 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.208799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.209036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.209202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.209366 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.209529 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.209690 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.209846 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.210009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.210163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.210325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.210481 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.210645 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.210809 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.210980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.211149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.211307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.211461 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.211621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.211784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.211940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.212093 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.212253 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.212445 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.212608 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.212773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.212927 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.213099 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.213261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.213432 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.213588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.213755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.213919 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.214073 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.214227 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.214381 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.214545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.214701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.214861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.215023 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.215195 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.215349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.215513 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.215669 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.215823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.215984 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.216138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.216326 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.216507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.216663 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.216824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.216977 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.217142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.217303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.217466 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.217621 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.217621 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.217922 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.218075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.218241 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.218396 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.218556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.218556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.218864 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.219018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.219191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.220187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.220385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.220554 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.220717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.221462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.221645 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.221813 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.221969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.222131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.222286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.222441 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.222610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.222783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.222783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.223085 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.223241 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.223404 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.223559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.223723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.223877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.224032 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.224192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.224382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.224543 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.224697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.224862 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.225017 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.225171 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.225334 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.225499 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.225655 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.225809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.225971 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.226133 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.226297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.226452 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.226606 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.226769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.226931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.227096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.227251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.227412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.227567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.227720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.227874 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.228041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.228210 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.228408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.228565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.228729 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.228902 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.229066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.229229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.229229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.229529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.229684 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.229855 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.230017 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.230172 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.230334 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.230490 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.230650 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.230828 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.230991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.231146 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.231307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.231462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.231622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.231788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.231944 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.232099 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.232251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.232431 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.232586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.232756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.232928 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.233091 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.233252 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.233414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.233583 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.233738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.233891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.234047 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.234207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.234361 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.234524 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.234686 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.234847 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.235593 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.235754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.235909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.236078 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.236241 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.236468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.236651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.236833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.237005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.237168 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.237331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.237492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.237666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.237820 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.237983 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.238144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.238308 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.238469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.238469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.238778 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.238943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.239097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.239097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.239521 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.239688 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.239854 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.240019 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.240175 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.240357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.240518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.240680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.240922 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.241080 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.241234 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.241234 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.241543 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.241715 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.241895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.242057 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.242219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.242392 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.242392 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.242693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.242862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.243016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.243176 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.243337 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.243499 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.243653 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.243816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.243816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.244129 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.244345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.244509 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.244679 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.244834 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.244989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.244989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.245296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.245459 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.245459 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.245762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.245916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.246087 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.246243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.246396 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.246565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.246565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.246858 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247165 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247326 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247493 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247655 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.247974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.248276 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.248471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.248632 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.248787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.248941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.249096 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.249096 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.249403 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.249556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.249709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.249875 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.250040 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.250204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.250359 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.250511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.250848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.251005 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.251005 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.251323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.251485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.251648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.251821 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.251976 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.252140 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.252332 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.252505 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.252661 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.252816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.252978 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.253144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.253301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.253455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.253610 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.253765 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.253927 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.254092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.254522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.254678 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.254841 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.255128 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.255302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.255467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.255629 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.255797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.255953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.256108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.256307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.256483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.256483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.256796 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.256951 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.257105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.257278 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.257435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.257589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.257743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.257903 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.257903 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.258212 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.258367 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.258529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.258696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.258856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.259020 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.259175 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.259335 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.259496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.259651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.259651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.259960 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.260115 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.260268 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.260457 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.260621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.260794 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.260963 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.261118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.261279 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.261440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.261440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.261767 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.261923 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.262876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.264041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.264041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.264041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.264041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.264041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.264821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.264983 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.265290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.265618 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.266048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.266447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.266798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.267333 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.267658 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.268099 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.268629 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.269108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.269793 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.270224 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.270569 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.271050 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.271378 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.271870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.272203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.272571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.273006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.273327 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.273821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.274335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.274805 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.275145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.275666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.276031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.276453 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.276799 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.277106 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.277474 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.277799 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.278119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.278442 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.278765 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.279087 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.279407 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.279726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.280054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.280397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.280720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.281039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.281358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.281680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.282718 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.283251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.283590 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.283921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.284246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.284616 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.285131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.285454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.285801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.286135 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.286503 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.286827 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.287159 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.287497 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.287815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.288134 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.288488 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.288808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.289125 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.289460 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.289779 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.290100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.290429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.290747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.291290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.291655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.291980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.292335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.292674 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.293000 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.293319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.293654 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.294341 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.294341 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.294592 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.294912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.295227 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.295541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.295861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.296181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.296520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.296937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.297254 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.298140 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.298456 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.298938 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.299258 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.299581 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.299898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.300221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.300563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.300881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.301204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.301520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.301837 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.302161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.302476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.302785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.303100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.303415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.303746 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.304161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.304441 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.304788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.305089 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.305516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.305842 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.306165 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.306519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.306846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.307401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.307744 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.308076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.308447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.308790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.309108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.309425 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.309770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.310064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.310391 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.310710 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.311030 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.311349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.311666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.311984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.312327 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.312649 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.312967 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.313333 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.313749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.313996 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.314318 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.314635 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.314958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.315309 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.315640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.315966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.316323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.316638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.316962 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.317330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.317596 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.317915 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.318240 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.318577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.318900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.319215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.319649 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.319968 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.320325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.320656 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.320973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.321280 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO dbcounter [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Registered counter for database nova_api Aug 03 18:49:33.321381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.321617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.321932 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.322259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.322579 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.322914 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.323260 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.323596 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.323930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.324246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.324587 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.324898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.325216 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.325539 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.325858 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.326173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.326484 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.326801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.327097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.327412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.327722 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.328034 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.328443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.328785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.329100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.329455 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.329724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.330033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.330349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.330665 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.330974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.331286 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.331593 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.331905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.332215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.332601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.332944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.333295 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.333600 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.333922 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.334253 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.334570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.334900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.335230 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.335554 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.335870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.336210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.336804 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.336984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.337305 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.337613 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.337924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.338248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.338584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.338919 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.339233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.339573 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.339906 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.340228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.340575 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.340895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.341230 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.341545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.341823 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_db.sqlalchemy.engines [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.341932 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.342163 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.342479 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.342797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.343113 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.343427 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.343745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.344066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.345001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.345439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.345837 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.346165 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.346507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.346840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.347206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.347525 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.347881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.348217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.348564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.348881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.349188 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 18:49:33.349422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writer thread running {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.349593 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129369) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 18:49:33.404617 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.context [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb8cd58f-50d6-42f2-8d04-20e0e2c543f2(cell1) {{(pid=129368) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 18:49:33.409462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:49:33.411417 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:49:33.411881 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:49:33.413126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO dbcounter [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Registered counter for database nova_api Aug 03 18:49:33.413874 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:49:33.415855 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO dbcounter [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Registered counter for database nova_cell0 Aug 03 18:49:33.419909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO dbcounter [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Registered counter for database nova_cell1 Aug 03 18:49:33.429075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_db.sqlalchemy.engines [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.429970 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_db.sqlalchemy.engines [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.434406 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_db.sqlalchemy.engines [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.436888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writer thread running {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.437168 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writer thread running {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.442294 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writer thread running {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.498870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.context [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb8cd58f-50d6-42f2-8d04-20e0e2c543f2(cell1) {{(pid=129369) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 18:49:33.503005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:49:33.504925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:49:33.505757 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:49:33.507745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:49:33.509775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO dbcounter [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Registered counter for database nova_cell0 Aug 03 18:49:33.513879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO dbcounter [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Registered counter for database nova_cell1 Aug 03 18:49:33.521921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_db.sqlalchemy.engines [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.523674 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_db.sqlalchemy.engines [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.529228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writer thread running {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.532498 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writer thread running {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.584640 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO dbcounter [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Registered counter for database nova_cell0 Aug 03 18:49:33.591358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_db.sqlalchemy.engines [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.596754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writer thread running {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.683918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO dbcounter [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Registered counter for database nova_cell0 Aug 03 18:49:33.691218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_db.sqlalchemy.engines [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129369) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 18:49:33.697251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writer thread running {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 18:49:33.918545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: WARNING keystonemiddleware.auth_token [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:49:33.926996 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: WARNING keystonemiddleware.auth_token [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:49:34.038154 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: WARNING keystonemiddleware.auth_token [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:49:34.045466 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: WARNING keystonemiddleware.auth_token [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:49:34.271953 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: WARNING keystonemiddleware.auth_token [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:49:34.278282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: WARNING keystonemiddleware.auth_token [None req-b85dab5e-21e7-400e-aacd-44b1085c8f48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:49:34.284439 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efb61369c0 pid: 129368 (default app) Aug 03 18:49:34.408036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: WARNING keystonemiddleware.auth_token [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 18:49:34.414716 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: WARNING keystonemiddleware.auth_token [None req-b7eed223-bec1-4b7c-9b20-161ca6e815b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 18:49:34.420039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efb61369c0 pid: 129369 (default app) Aug 03 18:50:11.006199 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=3 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:11.010029 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=3 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:11.011364 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=3 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:11.012578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=3 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:12.990408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0bd5d053-03c3-49c7-b1dc-43b5dfcb1fc8 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Action: 'create', calling method: .version_select at 0x7fdacbf85f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1813268288", "metadata": {"Type": "work"}}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0bd5d053-03c3-49c7-b1dc-43b5dfcb1fc8 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Request method failure captured: Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 122 Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNic7poTnZAgeTkluDvdC2DohT1ju2myli-C1ACEi9YxF8meY0vByeumgfyVTeia8FIsKZ7OVzD4PwyW2YZ2WmDCGoubcaTmenBwu7RbJVxf7j23_BlDgfYNkl4okktKGsQ5Z3AWpFdAveBfRRB2Uk2JFltapnFRHjPrGs5EUMLNp0 Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:50:13.004616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 2080b428e34c491d92e7df054c98105b Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1813268288", "metadata": {"Type": "work"}}} Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: Aug 03 18:50:13.006077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1813268288', 'metadata': {'Type': 'work'}}}} Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise error Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:50:13.006946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 18:50:13.008322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 18:50:13.009482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 18:50:13.009482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.011162 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0bd5d053-03c3-49c7-b1dc-43b5dfcb1fc8 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:50:13.012538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0bd5d053-03c3-49c7-b1dc-43b5dfcb1fc8 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.023050 Aug 03 18:50:13.013674 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1156 bytes} [Wed Aug 3 18:50:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2025 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 18:50:13.528124 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7d89c6ec-61f9-4165-8c13-db0411a4613c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Action: 'create', calling method: .version_select at 0x7fdacc062a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-525214196", "metadata": {"Type": "work"}}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7d89c6ec-61f9-4165-8c13-db0411a4613c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Request method failure captured: Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 119 Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sNic7poTnZAgeTkluDvdC2DohT1ju2myli-C1ACEi9YxF8meY0vByeumgfyVTeia8FIsKZ7OVzD4PwyW2YZ2WmDCGoubcaTmenBwu7RbJVxf7j23_BlDgfYNkl4okktKGsQ5Z3AWpFdAveBfRRB2Uk2JFltapnFRHjPrGs5EUMLNp0 Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:50:13.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 2080b428e34c491d92e7df054c98105b Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-525214196", "metadata": {"Type": "work"}}} Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: Aug 03 18:50:13.542322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-525214196', 'metadata': {'Type': 'work'}}}} Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise error Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi '0' Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:50:13.543109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 18:50:13.544465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 18:50:13.548148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 18:50:13.548148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.551143 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7d89c6ec-61f9-4165-8c13-db0411a4613c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:50:13.552958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7d89c6ec-61f9-4165-8c13-db0411a4613c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.532336 Aug 03 18:50:13.554178 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 1/2] 10.222.0.69 () {60 vars in 1156 bytes} [Wed Aug 3 18:50:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 535 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 18:50:13.575602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7050a89f-ea91-4f4e-a2a0-78e3439c1b9d tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Action: 'create', calling method: .version_select at 0x7fdacbe9eaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1648060365", "metadata": {"Type": "work"}}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7050a89f-ea91-4f4e-a2a0-78e3439c1b9d tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Request method failure captured: Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 119 Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNic7poTnZAgeTkluDvdC2DohT1ju2myli-C1ACEi9YxF8meY0vByeumgfyVTeia8FIsKZ7OVzD4PwyW2YZ2WmDCGoubcaTmenBwu7RbJVxf7j23_BlDgfYNkl4okktKGsQ5Z3AWpFdAveBfRRB2Uk2JFltapnFRHjPrGs5EUMLNp0 Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:50:13.579757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 2080b428e34c491d92e7df054c98105b Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1648060365", "metadata": {"Type": "work"}}} Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: Aug 03 18:50:13.581322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1648060365', 'metadata': {'Type': 'work'}}}} Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise error Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi '' Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:50:13.582207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 18:50:13.584628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 18:50:13.586976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 18:50:13.586976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:13.586976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7050a89f-ea91-4f4e-a2a0-78e3439c1b9d tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:50:13.587901 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7050a89f-ea91-4f4e-a2a0-78e3439c1b9d tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024709 Aug 03 18:50:13.596975 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:13.598055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:13.600356 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:13.601936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 2/3] 10.222.0.69 () {60 vars in 1156 bytes} [Wed Aug 3 18:50:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 18:50:13.602500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:13.616457 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d0323cb5-40e0-4ee8-b5cd-d35552dcb89c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Calling method '.version_select at 0x7fdacbfe9d30>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:13.739845 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-38b8c132-f9cd-4f9f-806e-0d8c87cd18ea tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbe59af0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:14.636344 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-d0323cb5-40e0-4ee8-b5cd-d35552dcb89c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] HTTP exception thrown: Volume tempest-invalid-1604560926 could not be found. Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d0323cb5-40e0-4ee8-b5cd-d35552dcb89c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Request method failure captured: Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1604560926 HTTP/1.1 Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sNic7poTnZAgeTkluDvdC2DohT1ju2myli-C1ACEi9YxF8meY0vByeumgfyVTeia8FIsKZ7OVzD4PwyW2YZ2WmDCGoubcaTmenBwu7RbJVxf7j23_BlDgfYNkl4okktKGsQ5Z3AWpFdAveBfRRB2Uk2JFltapnFRHjPrGs5EUMLNp0 Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:50:14.641233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 2080b428e34c491d92e7df054c98105b Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Volume tempest-invalid-1604560926 could not be found. Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'tempest-invalid-1604560926'} Aug 03 18:50:14.642953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1604560926 could not be found. (HTTP 404) (Request-ID: req-d5c4c825-c0c4-4294-80d6-c7b985027fef) Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.643857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 18:50:14.645577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1604560926 could not be found. Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:50:14.650028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1604560926 could not be found. Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1604560926 could not be found. Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.651781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d0323cb5-40e0-4ee8-b5cd-d35552dcb89c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Returning 404 to user: Volume tempest-invalid-1604560926 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:50:14.652605 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d0323cb5-40e0-4ee8-b5cd-d35552dcb89c tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1604560926" status: 404 len: 99 microversion: 2.1 time: 1.055187 Aug 03 18:50:14.661264 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1218 bytes} [Wed Aug 3 18:50:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1604560926 => generated 99 bytes in 1060 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 18:50:14.678988 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-64155c48-64b1-467f-82da-653275836c0d tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010227 Aug 03 18:50:14.685178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-38b8c132-f9cd-4f9f-806e-0d8c87cd18ea tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/a2cf1364-6cb8-4957-8669-3a5bcb547927" status: 200 len: 350 microversion: 2.1 time: 0.947268 Aug 03 18:50:14.685178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 3/5] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:50:13 2022] GET /compute/v2.1/os-volumes/a2cf1364-6cb8-4957-8669-3a5bcb547927 => generated 350 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:14.686398 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 3/6] 10.222.0.69 () {58 vars in 1140 bytes} [Wed Aug 3 18:50:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 03 18:50:14.691637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-74cbcfb9-00b2-489c-a587-d28730df16fa tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004429 Aug 03 18:50:14.697147 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1137 bytes} [Wed Aug 3 18:50:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 03 18:50:14.703328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c5e5b2f9-5c3f-4beb-9d8c-bb8a2b11155b tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Calling method '.version_select at 0x7fdacbd89af0>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:14.735982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-c5e5b2f9-5c3f-4beb-9d8c-bb8a2b11155b tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] HTTP exception thrown: Volume 061d9e28-d2de-4bc0-98a9-904804723732 could not be found. Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c5e5b2f9-5c3f-4beb-9d8c-bb8a2b11155b tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Request method failure captured: Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: DELETE /compute/v2.1/os-volumes/061d9e28-d2de-4bc0-98a9-904804723732 HTTP/1.1 Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sNic7poTnZAgeTkluDvdC2DohT1ju2myli-C1ACEi9YxF8meY0vByeumgfyVTeia8FIsKZ7OVzD4PwyW2YZ2WmDCGoubcaTmenBwu7RbJVxf7j23_BlDgfYNkl4okktKGsQ5Z3AWpFdAveBfRRB2Uk2JFltapnFRHjPrGs5EUMLNp0 Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:50:14.738560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 2080b428e34c491d92e7df054c98105b Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Volume 061d9e28-d2de-4bc0-98a9-904804723732 could not be found. Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '061d9e28-d2de-4bc0-98a9-904804723732'} Aug 03 18:50:14.740094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 061d9e28-d2de-4bc0-98a9-904804723732 could not be found. (HTTP 404) (Request-ID: req-bbfb2f99-f587-4d7d-bb8e-350b2625f30f) Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.741037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 18:50:14.742360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 061d9e28-d2de-4bc0-98a9-904804723732 could not be found. Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 18:50:14.743624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 061d9e28-d2de-4bc0-98a9-904804723732 could not be found. Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 061d9e28-d2de-4bc0-98a9-904804723732 could not be found. Aug 03 18:50:14.744898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.747885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c5e5b2f9-5c3f-4beb-9d8c-bb8a2b11155b tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Returning 404 to user: Volume 061d9e28-d2de-4bc0-98a9-904804723732 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:50:14.747885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c5e5b2f9-5c3f-4beb-9d8c-bb8a2b11155b tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/061d9e28-d2de-4bc0-98a9-904804723732" status: 404 len: 109 microversion: 2.1 time: 0.048811 Aug 03 18:50:14.747885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 18:50:14 2022] DELETE /compute/v2.1/os-volumes/061d9e28-d2de-4bc0-98a9-904804723732 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:50:14.762859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b2d74fbe-7a3b-4b6e-9abd-8bd755a59cd0 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Calling method '.version_select at 0x7fdacbdcc5e0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:14.805048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-b2d74fbe-7a3b-4b6e-9abd-8bd755a59cd0 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] HTTP exception thrown: Volume 4afe8460-b901-4d71-bf99-83f610032cb1 could not be found. Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b2d74fbe-7a3b-4b6e-9abd-8bd755a59cd0 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Request method failure captured: Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/os-volumes/4afe8460-b901-4d71-bf99-83f610032cb1 HTTP/1.1 Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNic7poTnZAgeTkluDvdC2DohT1ju2myli-C1ACEi9YxF8meY0vByeumgfyVTeia8FIsKZ7OVzD4PwyW2YZ2WmDCGoubcaTmenBwu7RbJVxf7j23_BlDgfYNkl4okktKGsQ5Z3AWpFdAveBfRRB2Uk2JFltapnFRHjPrGs5EUMLNp0 Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:50:14.810507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/8fa50cb14ff74c8c9ec93af52f98ae2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 8fa50cb14ff74c8c9ec93af52f98ae2b Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-VolumesNegativeTest-1665378551 Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 2080b428e34c491d92e7df054c98105b Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-VolumesNegativeTest-1665378551-project Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Volume 4afe8460-b901-4d71-bf99-83f610032cb1 could not be found. Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '4afe8460-b901-4d71-bf99-83f610032cb1'} Aug 03 18:50:14.812186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4afe8460-b901-4d71-bf99-83f610032cb1 could not be found. (HTTP 404) (Request-ID: req-068fd433-b83a-4512-9f52-c13d2791fc2d) Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.813178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 18:50:14.815053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4afe8460-b901-4d71-bf99-83f610032cb1 could not be found. Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 18:50:14.816474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4afe8460-b901-4d71-bf99-83f610032cb1 could not be found. Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4afe8460-b901-4d71-bf99-83f610032cb1 could not be found. Aug 03 18:50:14.817921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:50:14.821006 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b2d74fbe-7a3b-4b6e-9abd-8bd755a59cd0 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] Returning 404 to user: Volume 4afe8460-b901-4d71-bf99-83f610032cb1 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:50:14.822577 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b2d74fbe-7a3b-4b6e-9abd-8bd755a59cd0 tempest-VolumesNegativeTest-1665378551 tempest-VolumesNegativeTest-1665378551-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/4afe8460-b901-4d71-bf99-83f610032cb1" status: 404 len: 109 microversion: 2.1 time: 0.068562 Aug 03 18:50:14.824759 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 5/9] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:50:14 2022] GET /compute/v2.1/os-volumes/4afe8460-b901-4d71-bf99-83f610032cb1 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:50:16.459885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a69f3f7d-537d-423b-bf6e-842911e8d13d tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbd89430>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:16.965293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a69f3f7d-537d-423b-bf6e-842911e8d13d tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/293187db-4353-413b-8ee6-ead9451196d1" status: 200 len: 351 microversion: 2.1 time: 0.514872 Aug 03 18:50:16.974795 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 5/10] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:50:16 2022] GET /compute/v2.1/os-volumes/293187db-4353-413b-8ee6-ead9451196d1 => generated 351 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:18.888968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-01ed05e8-d16e-47d3-8906-865888678b96 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbdfdd30>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:19.015495 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-01ed05e8-d16e-47d3-8906-865888678b96 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/43d49bbd-1f34-4432-b82e-ed61f71031ed" status: 200 len: 351 microversion: 2.1 time: 0.137060 Aug 03 18:50:19.026229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 6/11] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:50:18 2022] GET /compute/v2.1/os-volumes/43d49bbd-1f34-4432-b82e-ed61f71031ed => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:19.029753 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ba8e313d-1cf7-430c-96c6-207c4b126742 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbda1040>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:19.314735 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ba8e313d-1cf7-430c-96c6-207c4b126742 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.288933 Aug 03 18:50:19.315611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1134 bytes} [Wed Aug 3 18:50:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:19.333893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b8198d51-8938-4e2e-9f63-036e8e2dce78 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbdfdaf0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:19.599451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b8198d51-8938-4e2e-9f63-036e8e2dce78 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.273915 Aug 03 18:50:19.618497 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e8ae675a-705b-42d5-9aaa-408de4b19ed1 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbda8280>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:19.619034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1149 bytes} [Wed Aug 3 18:50:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:19.829228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e8ae675a-705b-42d5-9aaa-408de4b19ed1 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213928 Aug 03 18:50:19.830297 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 7/14] 10.222.0.69 () {58 vars in 1134 bytes} [Wed Aug 3 18:50:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:19.843087 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-57c713f1-398a-43d2-b6c4-f2e593453e30 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbdd44c0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:20.038503 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-57c713f1-398a-43d2-b6c4-f2e593453e30 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.199322 Aug 03 18:50:20.039583 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 8/15] 10.222.0.69 () {58 vars in 1167 bytes} [Wed Aug 3 18:50:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:20.053351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1307521f-c97c-4c92-b81f-2fabd011f1a5 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbda8940>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:20.231384 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1307521f-c97c-4c92-b81f-2fabd011f1a5 tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.181786 Aug 03 18:50:20.241901 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1170 bytes} [Wed Aug 3 18:50:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:20.247814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-412d2cfa-6a10-4fbc-8a92-f06b6334a1af tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbda6700>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:20.410637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-412d2cfa-6a10-4fbc-8a92-f06b6334a1af tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.167150 Aug 03 18:50:20.412281 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 9/17] 10.222.0.69 () {58 vars in 1155 bytes} [Wed Aug 3 18:50:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:20.425999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-86688bea-c09c-4be9-ad14-d00f8e17f3ad tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbda1670>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:20.588876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-86688bea-c09c-4be9-ad14-d00f8e17f3ad tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.166863 Aug 03 18:50:20.589656 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 9/18] 10.222.0.69 () {58 vars in 1188 bytes} [Wed Aug 3 18:50:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:20.604682 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4972355d-81f5-409c-aac3-98c74251df2d tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] Calling method '.version_select at 0x7fdacbe59af0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:20.829450 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4972355d-81f5-409c-aac3-98c74251df2d tempest-VolumesTestJSON-1676672931 tempest-VolumesTestJSON-1676672931-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.228377 Aug 03 18:50:20.830365 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 10/19] 10.222.0.69 () {58 vars in 1155 bytes} [Wed Aug 3 18:50:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:23.864677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1267325197", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:24.145916 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] validate_networks() for [('d18d75c6-7a07-4f4e-8d93-dcdb199c0a5f', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:50:25.794719 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:50:25.795316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:50:25.795970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:50:25.797487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:50:25.798048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:50:25.833584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:25.838439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:25.839280 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:25.842377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:25.902482 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:50:25.936162 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for user c6085ba9dff1480a8a1674e492e0c6c3 and project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:50:25.983345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:50:25.988383 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:50:26.147168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2265d854-9e47-4dcc-bab1-63020192a027 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.571895 Aug 03 18:50:26.147825 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 10/20] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:50:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:50:26.161338 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d6c9e7d3-9682-424a-9370-81c53cf6d701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:26.163340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d6c9e7d3-9682-424a-9370-81c53cf6d701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:26.581798 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d6c9e7d3-9682-424a-9370-81c53cf6d701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:26.660229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d6c9e7d3-9682-424a-9370-81c53cf6d701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1222 microversion: 2.1 time: 0.503496 Aug 03 18:50:26.670820 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 11/21] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:26 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1222 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:26.953652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-381716535", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "networks": [{"uuid": "40eb1aaa-8dde-436d-91e1-a1a2a2a5ddef"}]}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:27.091214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] validate_networks() for [('40eb1aaa-8dde-436d-91e1-a1a2a2a5ddef', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:50:27.176170 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-464444447", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:27.550054 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] validate_networks() for [('d18d75c6-7a07-4f4e-8d93-dcdb199c0a5f', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:50:28.597685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:50:28.598331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:50:28.599292 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:50:28.599899 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:50:28.600502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:50:28.623607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:28.628335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:28.631541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:28.633302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:28.723104 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Getting quotas for project a9ad699f792e4c50a898079291f09254. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:50:28.747112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Getting quotas for user 1f99fcc5eddd45c89abca70f00ad6fed and project a9ad699f792e4c50a898079291f09254. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:50:28.812849 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:50:28.824669 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:50:28.982085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e3d0a638-3704-423a-8876-5c39b05a0403 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.724190 Aug 03 18:50:28.983935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 11/22] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:50:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:50:28.997195 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-80fcb4f5-7230-453e-bbb0-5f539617d016 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:28.998042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-80fcb4f5-7230-453e-bbb0-5f539617d016 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:29.301782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-80fcb4f5-7230-453e-bbb0-5f539617d016 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:29.331938 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-80fcb4f5-7230-453e-bbb0-5f539617d016 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1214 microversion: 2.1 time: 0.338871 Aug 03 18:50:29.333623 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 12/23] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:28 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1214 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:29.751591 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:50:29.752062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:50:29.752519 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:50:29.752942 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:50:29.753355 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:50:29.800873 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:29.806462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:29.808894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:29.815198 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:30.003847 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:50:30.023115 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for user c6085ba9dff1480a8a1674e492e0c6c3 and project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:50:30.088698 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:50:30.107698 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:50:30.382718 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-81128f1d-2a7e-4761-802d-253330a430d9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.213377 Aug 03 18:50:30.392169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 12/24] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:50:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 18:50:30.404564 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8d4f2763-55e8-4c8a-8e10-b831d20aa79f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:30.404786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1e908c74-e5f6-4338-a3ec-26f08ad2a1e5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'create', calling method: .version_select at 0x7fdacb4b7670>, body: {"keypair": {"name": "tempest-keypair-1530335597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE41wFeBnY+h6QwTCqy6aQDyhb2gYGR5lpS+dCVCadcpBLfTAxWWc46Lgmg0hPjvGCzQS9P8ugVVmFou/HF38ftnIN2CBUJPVt/2ydZhLmgNtj0P5nH3FX7QbTV3jUozkA=="}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:30.407821 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8d4f2763-55e8-4c8a-8e10-b831d20aa79f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:30.543210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-1e908c74-e5f6-4338-a3ec-26f08ad2a1e5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for project 77d5ff41add94950b7422c6de3e36257. Resources: {'key_pairs'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:50:30.552685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8d4f2763-55e8-4c8a-8e10-b831d20aa79f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:30.561886 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-1e908c74-e5f6-4338-a3ec-26f08ad2a1e5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for user 13ab977f852a41e898af1ddfb67bad69 and project 77d5ff41add94950b7422c6de3e36257. Resources: {'key_pairs'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:50:30.567077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8d4f2763-55e8-4c8a-8e10-b831d20aa79f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1214 microversion: 2.1 time: 0.173297 Aug 03 18:50:30.581483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 13/25] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:30 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:30.593995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5c43ee9e-bc85-4d2b-9cd2-4a7c854cadd5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:30.596409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5c43ee9e-bc85-4d2b-9cd2-4a7c854cadd5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:30.694237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1e908c74-e5f6-4338-a3ec-26f08ad2a1e5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.357828 Aug 03 18:50:30.694913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 13/26] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 18:50:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:31.274858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5c43ee9e-bc85-4d2b-9cd2-4a7c854cadd5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:31.287589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5c43ee9e-bc85-4d2b-9cd2-4a7c854cadd5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1221 microversion: 2.1 time: 0.703760 Aug 03 18:50:31.289523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 14/27] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:30 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1221 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:31.590431 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f53122e3-2ffa-419c-9c0e-2acd73448f1e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:31.591257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f53122e3-2ffa-419c-9c0e-2acd73448f1e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:32.369865 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f53122e3-2ffa-419c-9c0e-2acd73448f1e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:32.385012 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f53122e3-2ffa-419c-9c0e-2acd73448f1e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1214 microversion: 2.1 time: 0.796202 Aug 03 18:50:32.391776 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 14/28] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:31 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1214 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:32.404760 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:32.406033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:32.438724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:32.439179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:32.439993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:32.441461 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:32.959366 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c39888db-0c4f-489d-9f2b-204b821e160d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'create', calling method: .version_select at 0x7fdacb4625e0>, body: {"keypair": {"name": "tempest-keypair-2133230986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcpajVNjmSvySKFVslqK5vxD0PUQTY2n9vB+4xJYlBotkuogsjvN/xPu4OG47lR9lod1T02i867/JKbb5mAh3Vo/41yUdtmb3OJKyJJS7+2mEf3njVaxDqPLx9oTUe/5w=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:33.053191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-c39888db-0c4f-489d-9f2b-204b821e160d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for project e125626c9566484b837b582ba7096598. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:50:33.062471 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:33.084926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-c39888db-0c4f-489d-9f2b-204b821e160d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for user 1aa1d56d9b154e32aa1c136b577d49f4 and project e125626c9566484b837b582ba7096598. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:50:33.101958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-26f1785c-dd0b-400b-8635-8d1d9d171782 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1273 microversion: 2.1 time: 0.705163 Aug 03 18:50:33.105534 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 15/29] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:32 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1273 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:33.181565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c39888db-0c4f-489d-9f2b-204b821e160d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.064064 Aug 03 18:50:33.183405 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 15/30] 10.222.0.69 () {62 vars in 1200 bytes} [Wed Aug 3 18:50:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1066 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 03 18:50:33.407511 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:33.408155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:33.428553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:33.429028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:33.432198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:33.432716 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:33.687680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:33.700029 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f9a37f9d-d414-4ff0-807d-1f754ae93594 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1284 microversion: 2.1 time: 0.297495 Aug 03 18:50:33.703595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 16/31] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:33 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:34.128060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:34.129058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:34.144962 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:34.145493 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:34.159802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:34.160492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:34.726510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:34.727888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:34.745131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:34.746004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:34.747194 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:34.747852 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:35.031021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:35.068169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-48657eb8-9a43-4391-b13a-5d33909894a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1279 microversion: 2.1 time: 0.944425 Aug 03 18:50:35.089038 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 16/32] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:34 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1279 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:35.157087 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:35.180573 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9d5409b4-8f48-4590-8f43-bf4977dcaed3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1272 microversion: 2.1 time: 0.453241 Aug 03 18:50:35.183215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 17/33] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:34 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1272 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:36.098394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:36.099024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:36.117232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:36.117967 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:36.136589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:36.136589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:36.203935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:36.204936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:36.218429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:36.218915 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:36.219716 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:36.220162 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:36.349997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:36.370655 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-467358a6-2910-4434-a124-4b951926205a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1279 microversion: 2.1 time: 0.276345 Aug 03 18:50:36.374687 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 17/34] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:36 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:36.979986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:36.992125 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c31c7568-84c4-4e05-9564-a7c727a80ca2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1272 microversion: 2.1 time: 0.792382 Aug 03 18:50:36.993622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 18/35] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:36 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1272 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:37.397606 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:37.399527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:37.420973 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:37.426382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:37.428349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:37.435800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:37.854968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:37.870818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-432bb8e8-c9d6-4e0b-bf58-825594a6c65f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1279 microversion: 2.1 time: 0.478049 Aug 03 18:50:37.876044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 18/36] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:37 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1279 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:38.021090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:38.021772 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:38.033132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:38.041733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:38.042920 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:38.043500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:38.682474 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=4 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:38.897852 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:38.898661 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:38.922556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:38.933642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:38.934659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:38.935118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:39.544274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:39.560339 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7e947333-45d3-4135-8aef-3d616f6e2f86 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1279 microversion: 2.1 time: 0.668624 Aug 03 18:50:39.586436 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 19/37] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:38 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1279 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:40.212144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:40.227542 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dae739e5-30d4-4414-a847-5a5d82febf18 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 2.207048 Aug 03 18:50:40.228843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 19/38] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:38 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:40.596578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:40.597842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:40.605657 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:40.632726 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:40.641952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:40.643136 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:40.643721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:41.010591 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:41.023441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6c000c17-5e35-4840-a041-16783c535d4e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1279 microversion: 2.1 time: 0.431453 Aug 03 18:50:41.024664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 20/39] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:40 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1279 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:41.260000 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:41.260000 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:41.287940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:41.288436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:41.289227 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:41.289668 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:41.458908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-e60339c6-61d8-40ca-9471-c813ef8d30b4 req-20c2aa15-7438-4fa4-8b26-827eaba993ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeaec340-ee41-4cc1-9812-e9840770a738", "tag": "48af6877-730c-4819-a241-1d10a1f9f608"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:41.476623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-e60339c6-61d8-40ca-9471-c813ef8d30b4 req-20c2aa15-7438-4fa4-8b26-827eaba993ca service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:41.486804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-e60339c6-61d8-40ca-9471-c813ef8d30b4 req-20c2aa15-7438-4fa4-8b26-827eaba993ca service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:41.579711 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-e60339c6-61d8-40ca-9471-c813ef8d30b4 req-20c2aa15-7438-4fa4-8b26-827eaba993ca service nova] Creating event network-changed:48af6877-730c-4819-a241-1d10a1f9f608 for instance eeaec340-ee41-4cc1-9812-e9840770a738 on hv-cinder-85164 Aug 03 18:50:41.592727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-e60339c6-61d8-40ca-9471-c813ef8d30b4 req-20c2aa15-7438-4fa4-8b26-827eaba993ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=129368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 18:50:41.594490 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2301143e-362d-4a46-84d8-ac52adf9587a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:41.596433 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2301143e-362d-4a46-84d8-ac52adf9587a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:41.602796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2301143e-362d-4a46-84d8-ac52adf9587a None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:41.603995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2301143e-362d-4a46-84d8-ac52adf9587a None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:41.640178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.compute.rpcapi [None req-2301143e-362d-4a46-84d8-ac52adf9587a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 18:50:41.657297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2301143e-362d-4a46-84d8-ac52adf9587a None None] Releasing lock "compute-rpcapi-router" {{(pid=129368) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 18:50:41.719353 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2301143e-362d-4a46-84d8-ac52adf9587a None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.440835 Aug 03 18:50:41.721029 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 21/40] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:41.802512 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:41.816373 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-90ea20c2-d412-44e3-a0cb-25d85fbc0a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.560883 Aug 03 18:50:41.818450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 20/41] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:41 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:42.056326 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:42.056967 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:42.074481 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:42.075130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:42.076179 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:42.077685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:42.102141 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1169512042", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "701843e1-2e94-48b3-9b51-56f740f224e4"}], "security_groups": [{"name": "tempest-securitygroup--120214493"}], "key_name": "tempest-keypair-1530335597", "user_data": "}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:42.380838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=20 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:42.593298 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:42.612919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-82cebaaa-cdd8-467e-82d6-80bf4be3abe6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.564653 Aug 03 18:50:42.631005 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 22/42] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:42 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:42.632203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] validate_networks() for [('701843e1-2e94-48b3-9b51-56f740f224e4', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:50:42.846237 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:42.848848 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:42.875809 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:42.878168 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:42.881231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:42.884083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:43.116567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=16 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:43.654295 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:43.663621 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-298dadc8-a169-4441-bf27-e939f120728b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.827121 Aug 03 18:50:43.666846 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 23/43] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:42 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:43.710328 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:43.711064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:43.726617 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:43.727081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:43.727875 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:43.728342 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:44.759181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:50:44.763964 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:50:44.769029 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:50:44.771808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:44.772401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:50:44.772637 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:50:44.783659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f33123d6-0b7f-49a8-b024-e46417967092 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 1.098314 Aug 03 18:50:44.791066 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 24/44] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:43 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:44.804501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1076282952", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77f2cd46-7c63-471b-8d5f-e72bc8dfc1dd"}], "security_groups": [{"name": "tempest-securitygroup--951329255"}], "key_name": "tempest-keypair-2133230986", "user_data": "}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:44.864597 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:44.865855 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:44.871582 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:44.872777 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:44.929924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for project 77d5ff41add94950b7422c6de3e36257. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:50:44.935532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for user 13ab977f852a41e898af1ddfb67bad69 and project 77d5ff41add94950b7422c6de3e36257. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:50:44.986211 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:50:44.996008 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:50:45.075149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] validate_networks() for [('77f2cd46-7c63-471b-8d5f-e72bc8dfc1dd', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:50:45.156142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dfa753d0-c346-4ffe-a0bf-22d3c1e25a45 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.059762 Aug 03 18:50:45.158039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 21/45] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:50:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:50:45.175036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-b352b1b4-ceea-47a8-9e1a-372266baa7a3 req-08d99cc2-6c84-4915-8b4a-f0519d561d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44a440b7-980a-4d76-9813-92f7ac63eace", "tag": "152f3dd3-5003-42f8-b1bd-b9b7d951effd"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:45.240421 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b352b1b4-ceea-47a8-9e1a-372266baa7a3 req-08d99cc2-6c84-4915-8b4a-f0519d561d92 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:45.241343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b352b1b4-ceea-47a8-9e1a-372266baa7a3 req-08d99cc2-6c84-4915-8b4a-f0519d561d92 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:45.288870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-b352b1b4-ceea-47a8-9e1a-372266baa7a3 req-08d99cc2-6c84-4915-8b4a-f0519d561d92 service nova] Creating event network-changed:152f3dd3-5003-42f8-b1bd-b9b7d951effd for instance 44a440b7-980a-4d76-9813-92f7ac63eace on hv-cinder-85164 Aug 03 18:50:45.289813 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b352b1b4-ceea-47a8-9e1a-372266baa7a3 req-08d99cc2-6c84-4915-8b4a-f0519d561d92 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129369) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 18:50:45.292216 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c34d73ca-19f1-4510-a436-10a4ecf0cc4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:45.293100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c34d73ca-19f1-4510-a436-10a4ecf0cc4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:45.294485 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c34d73ca-19f1-4510-a436-10a4ecf0cc4a None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:45.296845 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c34d73ca-19f1-4510-a436-10a4ecf0cc4a None None] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:45.309564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.compute.rpcapi [None req-c34d73ca-19f1-4510-a436-10a4ecf0cc4a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 18:50:45.321615 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c34d73ca-19f1-4510-a436-10a4ecf0cc4a None None] Releasing lock "compute-rpcapi-router" {{(pid=129369) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 18:50:45.369552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c34d73ca-19f1-4510-a436-10a4ecf0cc4a None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207500 Aug 03 18:50:45.371398 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 22/46] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:45.383643 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:45.384364 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:45.416895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:45.417536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:45.418729 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:45.419312 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:45.872784 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:45.886691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-948377a7-2637-4cef-a53e-9df49ba2ec6f tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.510399 Aug 03 18:50:45.888096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 23/47] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:45 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:45.897636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e4369003-1151-4421-8e41-fefddfb5a61f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:45.901907 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e4369003-1151-4421-8e41-fefddfb5a61f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:46.009280 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e4369003-1151-4421-8e41-fefddfb5a61f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:46.019181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e4369003-1151-4421-8e41-fefddfb5a61f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1238 microversion: 2.1 time: 0.129928 Aug 03 18:50:46.020835 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 24/48] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:45 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:46.046815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:46.047621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:46.073345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:46.074457 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:46.079775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:46.080466 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:46.263231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:50:46.263717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:50:46.264816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:50:46.265138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:50:46.265562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:50:46.309800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:46.314098 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:46.315214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:46.320004 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:46.380515 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for project e125626c9566484b837b582ba7096598. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:50:46.386818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for user 1aa1d56d9b154e32aa1c136b577d49f4 and project e125626c9566484b837b582ba7096598. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:50:46.388604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:46.414112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b8c0b8fe-a68c-4f58-adb7-e4b099c094ba tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.390070 Aug 03 18:50:46.418622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 25/49] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:46 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:46.421200 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:50:46.423826 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:50:46.528954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ceb9c114-c706-4b4b-a64e-d65fe4a1b039 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.735806 Aug 03 18:50:46.529708 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 25/50] 10.222.0.69 () {62 vars in 1188 bytes} [Wed Aug 3 18:50:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 18:50:46.546973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c598bdba-16eb-48c4-8352-a454f87980c6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:46.549326 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c598bdba-16eb-48c4-8352-a454f87980c6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:46.838247 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c598bdba-16eb-48c4-8352-a454f87980c6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:46.854807 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c598bdba-16eb-48c4-8352-a454f87980c6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:46.863558 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c598bdba-16eb-48c4-8352-a454f87980c6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:46.878436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c598bdba-16eb-48c4-8352-a454f87980c6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1282 microversion: 2.20 time: 0.338072 Aug 03 18:50:46.897649 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 26/51] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:46 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1282 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:46.917897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:46.918653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:46.929870 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:46.931333 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:46.934041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:46.934545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:47.046955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:47.047873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:47.059408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:47.060104 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:47.061981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:47.062714 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:47.211028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:47.219352 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8792cf4e-cb90-4e28-bfdf-20d2e4e20ffd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1242 microversion: 2.1 time: 0.178536 Aug 03 18:50:47.219949 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 27/52] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:47 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1242 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:47.332855 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:47.354599 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f4a31a25-e874-41ba-804a-cf24b21257c3 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.440486 Aug 03 18:50:47.360888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 26/53] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:46 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:47.456336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:47.459222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:47.464322 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:47.469601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:47.470272 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:47.471219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:47.471999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:47.703185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:47.718360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-75fad85d-f810-4784-b1f5-6889cf6b230a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.275212 Aug 03 18:50:47.719454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 28/54] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:47 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:47.904345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:47.905328 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:47.926746 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:47.927500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:47.939898 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:47.940751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:48.073075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:48.084799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:48.092345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:48.095426 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3dd377b0-95fe-42c6-a26f-13617fdee274 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1286 microversion: 2.20 time: 0.195222 Aug 03 18:50:48.098296 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 27/55] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:47 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:48.246259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:48.249541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:48.274746 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:48.275443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:48.278135 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:48.278810 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:48.385995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:48.386575 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:48.410741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:48.418992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:48.419867 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:48.420411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:48.439049 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:48.450289 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1d526898-78b0-4c66-b2b0-13e291bacdac tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1242 microversion: 2.1 time: 0.213982 Aug 03 18:50:48.454121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 29/56] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:48 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:48.731171 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:48.741758 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:48.742746 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:48.757242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ab8f0704-5e06-4aba-8fed-cb678d5334a2 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.377347 Aug 03 18:50:48.773289 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 28/57] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:48 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:48.773935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:48.774731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:48.775775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:48.776821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:48.923634 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:48.931167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-939fc6c1-042e-4338-baf7-331b8a5507b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.194903 Aug 03 18:50:48.940646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 30/58] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:48 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:49.131022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:49.132453 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:49.142735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.143316 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:49.144125 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.144701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:49.226663 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:49.237144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:49.238891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:49.240188 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c1b51b4a-280c-4e43-a297-9564c2d8f65a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1286 microversion: 2.20 time: 0.117424 Aug 03 18:50:49.240920 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 29/59] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:49 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:49.478504 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:49.479365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:49.485806 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.486262 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:49.487058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.487496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:49.557837 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:49.566272 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d95e6acf-d895-4b40-97b6-f465f60243cb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1242 microversion: 2.1 time: 0.091551 Aug 03 18:50:49.566878 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 31/60] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:49 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:49.784562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:49.785129 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:49.791460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.792206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:49.793230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.793741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:49.954003 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:49.954799 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:49.967299 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.967747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:49.971995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:49.973316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:50.390679 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:50.399657 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-be7a8c96-1793-404a-8d8a-af3c6cfd004c tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.619007 Aug 03 18:50:50.406967 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 30/61] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:49 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:50.415010 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:50.421327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:50.445771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:50.446757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:50.458920 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:50.459659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:50.682300 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:50.692897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:50.697546 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:50.700611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-910b77b1-b266-46ee-bfed-06fce2e9fd68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1278 microversion: 2.20 time: 0.292396 Aug 03 18:50:50.702095 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 31/62] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:50 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:50.707062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:50.707753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:50.713975 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:50.714509 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:50.715344 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:50.715854 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:50.726267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:50.734522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cd7825f8-03a8-416e-8578-1714511cd6b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.785297 Aug 03 18:50:50.735108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 32/63] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:49 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:50.865748 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:50.877159 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5beab029-6e77-488d-8a03-75649fc2924a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1290 microversion: 2.1 time: 0.173795 Aug 03 18:50:50.891257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 32/64] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:50 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1290 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:51.253931 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-9b19bbf4-87eb-4cbe-bdbf-494ca1fe9284 req-e281b646-d854-4e52-85eb-d10661c5ea6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab63b03-b37e-4d91-afa5-6b01ae41f2e6", "tag": "109d7749-0d32-4e07-97a5-8d873fc9a14c"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:51.268408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9b19bbf4-87eb-4cbe-bdbf-494ca1fe9284 req-e281b646-d854-4e52-85eb-d10661c5ea6e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:51.268408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9b19bbf4-87eb-4cbe-bdbf-494ca1fe9284 req-e281b646-d854-4e52-85eb-d10661c5ea6e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:51.279769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-9b19bbf4-87eb-4cbe-bdbf-494ca1fe9284 req-e281b646-d854-4e52-85eb-d10661c5ea6e service nova] Creating event network-changed:109d7749-0d32-4e07-97a5-8d873fc9a14c for instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 on hv-cinder-85164 Aug 03 18:50:51.286726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-9b19bbf4-87eb-4cbe-bdbf-494ca1fe9284 req-e281b646-d854-4e52-85eb-d10661c5ea6e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103996 Aug 03 18:50:51.287569 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 33/65] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:51.437674 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:51.439036 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:51.451988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:51.456246 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:51.459134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:51.460768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:51.469914 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:51.728190 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:51.729539 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:51.745319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:51.746328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:51.747293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:51.747897 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:51.783724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:52.193465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:52.209562 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:52.212730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:52.220979 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-148acfed-d6da-440e-b0b4-dc508ea8025c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1340 microversion: 2.20 time: 0.497837 Aug 03 18:50:52.222600 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:51 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1340 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:52.227602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:52.231325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:52.244834 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:52.247730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:52.250077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:52.256959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:52.571781 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:52.589957 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e3ea208f-1a05-4466-a265-367efb5a4cbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 1.159297 Aug 03 18:50:52.590550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 33/67] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:51 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:52.608637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:52.609580 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:52.619067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:52.619738 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:52.620854 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:52.621574 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:52.789627 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:52.819714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-62ec002d-2e31-45bf-9a6c-c4d7afa82390 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1296 microversion: 2.1 time: 0.227222 Aug 03 18:50:52.820662 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 34/68] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:52 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:53.139117 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:53.147903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e6a44d84-55f4-4bc3-bf31-f037b1e2b296 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.924129 Aug 03 18:50:53.152640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 35/69] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:52 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:53.245830 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:53.246438 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:53.255837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:53.256647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:53.258024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:53.258678 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:53.434826 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:53.445132 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:53.446889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:53.448021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2180a130-6271-45e2-a989-9c1b2d1122ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.206125 Aug 03 18:50:53.450001 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 35/70] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:53 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:53.615149 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:53.615982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:53.627424 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:53.627883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:53.628686 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:53.629398 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:53.811598 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:53.821896 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c2854df8-f190-467d-9329-06785f45cdc6 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.210297 Aug 03 18:50:53.822885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 36/71] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:53 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:53.843723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:53.844525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:53.852577 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:53.853041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:53.853819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:53.854256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:54.026059 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:54.041915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7b9a9882-e4cf-4c43-af99-260fc627b8cd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.202741 Aug 03 18:50:54.042761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 36/72] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:53 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:54.177684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:54.180236 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:54.191881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:54.192892 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:54.194443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:54.195261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:54.442149 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:54.458089 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0cf217e8-cfcc-4d27-9c80-ec39350e0bab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.288040 Aug 03 18:50:54.460345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 37/73] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:54 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:54.473705 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:54.474504 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:54.478310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:54.487573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:54.488413 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:54.491205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:54.491891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:54.777679 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:54.786481 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:54.787999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:54.796422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6a66484b-6fee-40cd-9922-56e523a5387e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.325331 Aug 03 18:50:54.797774 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 37/74] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:54 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:54.849270 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:54.850436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:54.858085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:54.858923 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:54.860024 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:54.860787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:55.068208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:55.069411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:55.081111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:55.081980 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:55.083403 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:55.084155 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:55.112210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:55.119672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-373e0da8-e180-4bd4-a37a-c712dd564a62 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.277815 Aug 03 18:50:55.120272 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 38/75] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:54 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:55.300647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:55.310266 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ce0820df-080e-4614-ad1f-756a1dda207b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.246800 Aug 03 18:50:55.311341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 38/76] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:55 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:55.482285 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:55.483243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:55.487221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=4 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:55.491491 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:55.492147 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:55.493030 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:55.493675 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:55.818943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:55.819564 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:55.832920 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:55.837109 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:55.838972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:55.839688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:56.255607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:56.270364 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2ff8e097-f0db-4a87-a9d6-fe6d0daebb2a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.794473 Aug 03 18:50:56.273185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 39/77] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:55 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:56.284858 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:56.287596 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:56.307251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:56.308981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:56.311713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:56.313619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:56.356265 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=4 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:56.414723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:56.840470 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:56.843597 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=10 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:50:56.860426 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:56.862142 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:56.865440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d8831282-20c3-40bc-8b6a-dab4176a0bb1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 1.050289 Aug 03 18:50:56.869573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 39/78] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:55 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:50:56.882748 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:56.883395 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:56.904086 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:56.908839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:56.913548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:56.914546 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:57.200087 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:57.211052 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f8860289-bb3e-4712-99d4-3392306a5b27 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.936504 Aug 03 18:50:57.211841 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 40/79] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:56 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:57.237602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-8b8559c4-4f36-4fd4-90e4-6a088fe23b69 req-1ee45113-68e2-46c5-969a-b6275bcb605c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75afca33-3ec7-4c03-9d25-a247fc1e47bd", "tag": "1407aa85-6899-475c-a3c7-c06872937b88"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:57.255672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-8b8559c4-4f36-4fd4-90e4-6a088fe23b69 req-1ee45113-68e2-46c5-969a-b6275bcb605c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:57.256167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-8b8559c4-4f36-4fd4-90e4-6a088fe23b69 req-1ee45113-68e2-46c5-969a-b6275bcb605c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:57.273744 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-8b8559c4-4f36-4fd4-90e4-6a088fe23b69 req-1ee45113-68e2-46c5-969a-b6275bcb605c service nova] Creating event network-changed:1407aa85-6899-475c-a3c7-c06872937b88 for instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd on hv-cinder-85164 Aug 03 18:50:57.283405 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-8b8559c4-4f36-4fd4-90e4-6a088fe23b69 req-1ee45113-68e2-46c5-969a-b6275bcb605c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047448 Aug 03 18:50:57.284989 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 41/80] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:50:57.299392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:57.300139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:57.316340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:57.317436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:57.318539 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:57.319139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:57.424922 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:57.457331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fd4886bb-80df-4c29-80cb-7fea3dcf44ca tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.572253 Aug 03 18:50:57.459248 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 40/81] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:56 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:57.591423 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:57.611641 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d9f21db6-6610-4c8c-8cfd-72fd35852458 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.311592 Aug 03 18:50:57.611641 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 42/82] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:57 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:57.895384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:57.896262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:57.905629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:57.906639 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:57.908251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:57.909139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:58.073465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:58.085643 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:58.088204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:58.090792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-92cfe43a-91b8-4851-a5ec-e609c508a889 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.200397 Aug 03 18:50:58.091411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 41/83] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:57 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:58.246695 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:58.249662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:58.260401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:58.261423 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:58.262403 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:58.263011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:58.480737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:58.482903 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:58.492071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:58.492788 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:58.494207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:58.494917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:58.822797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:58.837832 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b00fc291-bb46-41b1-8023-864104f1d8bb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.596423 Aug 03 18:50:58.840700 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 43/84] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:58 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:58.848148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:58.850470 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:58.852724 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:58.863196 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2ce91881-2345-4efb-8019-bb81fbcdcff5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.387199 Aug 03 18:50:58.864768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 42/85] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:58 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:50:58.866873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:58.871292 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:58.872557 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:58.873495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:59.070558 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:59.080978 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-847abca9-cc5e-47ad-94b4-1e0104234dff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.238022 Aug 03 18:50:59.082311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 44/86] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:58 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:50:59.115477 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:59.116178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:59.125732 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:59.129470 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:59.130300 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:59.132939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:59.307913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-e17cfbef-5829-4191-a7c5-c325e448bbd8 req-512977f7-66f5-467f-9b4a-7e0910ae28cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800ff343-a07b-438f-9353-240b8ce592a9", "tag": "c4284c49-f7bf-4ba4-bb52-eab9c9c73389"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:59.318436 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:59.335911 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-e17cfbef-5829-4191-a7c5-c325e448bbd8 req-512977f7-66f5-467f-9b4a-7e0910ae28cf service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:59.338014 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:59.338863 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-e17cfbef-5829-4191-a7c5-c325e448bbd8 req-512977f7-66f5-467f-9b4a-7e0910ae28cf service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:59.341468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:50:59.347683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bd3bc3ca-b1c9-4bdf-b6c5-dae868cf55e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.235069 Aug 03 18:50:59.349848 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 43/87] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:50:59 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:50:59.403775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-e17cfbef-5829-4191-a7c5-c325e448bbd8 req-512977f7-66f5-467f-9b4a-7e0910ae28cf service nova] Creating event network-changed:c4284c49-f7bf-4ba4-bb52-eab9c9c73389 for instance 800ff343-a07b-438f-9353-240b8ce592a9 on hv-cinder-85164 Aug 03 18:50:59.411275 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-e17cfbef-5829-4191-a7c5-c325e448bbd8 req-512977f7-66f5-467f-9b4a-7e0910ae28cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108614 Aug 03 18:50:59.413391 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 45/88] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:50:59.862798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:50:59.863504 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:50:59.874536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:59.874993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:59.875769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:59.876211 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:50:59.974632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-ee5c53fa-53d1-4990-89f4-f7d8da524e33 req-123d4863-5fd2-4e55-a5da-a3de5337bcad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a440b7-980a-4d76-9813-92f7ac63eace", "name": "network-vif-plugged", "status": "completed", "tag": "152f3dd3-5003-42f8-b1bd-b9b7d951effd"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:50:59.987631 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-ee5c53fa-53d1-4990-89f4-f7d8da524e33 req-123d4863-5fd2-4e55-a5da-a3de5337bcad service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:50:59.987865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-ee5c53fa-53d1-4990-89f4-f7d8da524e33 req-123d4863-5fd2-4e55-a5da-a3de5337bcad service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:00.003817 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-ee5c53fa-53d1-4990-89f4-f7d8da524e33 req-123d4863-5fd2-4e55-a5da-a3de5337bcad service nova] Creating event network-vif-plugged:152f3dd3-5003-42f8-b1bd-b9b7d951effd for instance 44a440b7-980a-4d76-9813-92f7ac63eace on hv-cinder-85164 Aug 03 18:51:00.010548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-ee5c53fa-53d1-4990-89f4-f7d8da524e33 req-123d4863-5fd2-4e55-a5da-a3de5337bcad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203837 Aug 03 18:51:00.011347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 44/89] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:00.019166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:00.019881 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:00.027705 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:00.028163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:00.028977 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:00.029613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:00.054098 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:00.069443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a590e353-75b0-4ecb-9ca9-a403414f5a5d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.211262 Aug 03 18:51:00.071534 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 46/90] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:50:59 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:00.103361 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:00.108357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:00.117767 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:00.118422 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:00.119251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:00.119759 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:00.345265 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:00.348279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:00.357968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c030faf7-a5ff-43ca-be5f-444184fd3a46 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.344701 Aug 03 18:51:00.359220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e2e864ca-0586-4ada-9f9e-bb172fc68abb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.259373 Aug 03 18:51:00.359436 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 45/91] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:00 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:00.368689 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 47/92] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:00 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:00.377199 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:00.378172 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:00.387002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:00.394193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:00.395282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:00.395832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:00.550839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:00.563630 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:00.565235 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:00.566382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b20fdb76-e920-4f92-9e35-c8f6e7ddb122 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.198383 Aug 03 18:51:00.566943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 46/93] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:00 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:01.092887 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:01.093507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:01.102245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.103454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:01.105519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.106635 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:01.278005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:01.286740 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-431783c0-2d2d-4563-9881-da0bdd27eef8 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.198695 Aug 03 18:51:01.287528 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 48/94] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:01 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:01.383414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:01.384005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:01.385564 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:01.386224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:01.392798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.393365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:01.394205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.394756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.395105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:01.395816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:01.398171 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.398784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:01.679732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:01.686656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:01.692606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-577d9bd8-4640-423b-84b4-fd013c3e1e00 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.312468 Aug 03 18:51:01.695549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 49/95] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:01 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:01.696108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d893605d-dd5a-44c5-9630-8789ed3ab5bb tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.318038 Aug 03 18:51:01.697463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 47/96] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:01 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:01.710585 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:01.711780 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:01.718861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.719563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:01.720693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:01.721284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:02.011201 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:02.022763 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:02.025695 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:02.027050 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2df0b3d1-3868-4d2a-bdac-7f2d98cca460 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.330431 Aug 03 18:51:02.027916 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 50/97] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:01 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:02.310778 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:02.311751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:02.323286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:02.324450 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:02.329472 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:02.330113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:02.717462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:02.718089 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:02.734516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:02.734982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:02.735767 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:02.736207 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:02.940764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:02.949455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-770e4a45-22fa-4e55-b2bd-06e90fa1fc91 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.644308 Aug 03 18:51:02.952529 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 48/98] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:02 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:02.966511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:02.969285 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:02.985557 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:02.986032 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:02.986844 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:02.987240 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:03.188062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:03.198039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b942d8bc-0afa-46a6-92a0-53f33d973a1f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.485217 Aug 03 18:51:03.198669 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 51/99] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:02 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:03.212125 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:03.212963 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:03.232889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:03.233358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:03.234114 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:03.234545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:03.272002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:03.510394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:03.521999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-91f35a01-9910-410d-a8f8-924ced422f42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.568160 Aug 03 18:51:03.522619 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 49/100] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:02 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:03.591739 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-13e7733c-aae8-4031-990c-9b63f977e197 req-180f65b3-01be-4f6a-81eb-2c953cd86f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab63b03-b37e-4d91-afa5-6b01ae41f2e6", "name": "network-vif-plugged", "status": "completed", "tag": "109d7749-0d32-4e07-97a5-8d873fc9a14c"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:03.629418 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-13e7733c-aae8-4031-990c-9b63f977e197 req-180f65b3-01be-4f6a-81eb-2c953cd86f6e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:03.630385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-13e7733c-aae8-4031-990c-9b63f977e197 req-180f65b3-01be-4f6a-81eb-2c953cd86f6e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:03.641555 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:03.659522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:03.661117 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:03.662251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-33965f5d-3d00-4801-b5c9-f9868be3c76b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.454595 Aug 03 18:51:03.662818 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 52/101] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:03 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:03.669353 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-13e7733c-aae8-4031-990c-9b63f977e197 req-180f65b3-01be-4f6a-81eb-2c953cd86f6e service nova] Creating event network-vif-plugged:109d7749-0d32-4e07-97a5-8d873fc9a14c for instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 on hv-cinder-85164 Aug 03 18:51:03.683620 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-13e7733c-aae8-4031-990c-9b63f977e197 req-180f65b3-01be-4f6a-81eb-2c953cd86f6e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095697 Aug 03 18:51:03.684816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 50/102] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:51:03.971808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:03.974632 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:03.981266 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:03.981829 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:03.983278 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:03.984231 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:04.225658 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:04.226116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:04.227055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:04.234480 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4ef1dffb-3e13-45d7-ac89-c91dd50a2d1d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.266753 Aug 03 18:51:04.236978 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:04.237667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:04.238646 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:04.240214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:04.240696 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 53/103] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:03 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:04.246240 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:04.421144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:04.429187 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-738629bf-1f3c-4028-932f-a8e57139ce0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.208821 Aug 03 18:51:04.429943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 51/104] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:04 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:04.547849 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:04.561773 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:04.581811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:04.584527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:04.585574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:04.587934 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:04.689562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:04.690341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:04.697889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:04.704556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:04.705974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:04.706762 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:05.001562 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:05.017681 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9441d5e5-1cb0-4a47-a7d0-a4e468935534 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.474181 Aug 03 18:51:05.018337 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 54/105] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:04 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:05.024716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:05.038591 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:05.040431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:05.041641 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ee5d5ea3-0ae5-4bde-b75d-dc5e74382979 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.356500 Aug 03 18:51:05.046619 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 52/106] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:04 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:05.255439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:05.256186 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:05.266445 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:05.266917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:05.268622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:05.270244 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:05.452677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:05.453287 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:05.461146 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:05.462959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:05.468079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:05.472548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:05.518550 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:05.536050 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f524f9ba-f1bc-4bbf-9c30-453c304f9798 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.284745 Aug 03 18:51:05.548323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 55/107] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:05 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:05.705238 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-40a70a9a-597a-4cf0-b491-a350d74cf6b1 req-3a9397d7-8960-4586-99ef-0be0aabc166b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeaec340-ee41-4cc1-9812-e9840770a738", "name": "network-vif-plugged", "status": "completed", "tag": "48af6877-730c-4819-a241-1d10a1f9f608"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:05.715817 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-40a70a9a-597a-4cf0-b491-a350d74cf6b1 req-3a9397d7-8960-4586-99ef-0be0aabc166b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:05.717126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-40a70a9a-597a-4cf0-b491-a350d74cf6b1 req-3a9397d7-8960-4586-99ef-0be0aabc166b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:05.731225 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-40a70a9a-597a-4cf0-b491-a350d74cf6b1 req-3a9397d7-8960-4586-99ef-0be0aabc166b service nova] Creating event network-vif-plugged:48af6877-730c-4819-a241-1d10a1f9f608 for instance eeaec340-ee41-4cc1-9812-e9840770a738 on hv-cinder-85164 Aug 03 18:51:05.739221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-40a70a9a-597a-4cf0-b491-a350d74cf6b1 req-3a9397d7-8960-4586-99ef-0be0aabc166b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037513 Aug 03 18:51:05.740002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 56/108] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:51:05.882534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:05.892155 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ed36e4d8-f55a-43af-86f0-72bb2fdbcfc6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.443619 Aug 03 18:51:05.905612 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 53/109] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:05 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:06.039912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:06.040644 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:06.047492 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.047941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:06.048953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.049442 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:06.067440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:06.068062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:06.076528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.076982 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:06.077768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.078206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:06.304696 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:06.312602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8c344680-8360-401f-b2af-6b3e278008e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.277318 Aug 03 18:51:06.313169 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 57/110] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:06 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:06.331399 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:06.340944 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:06.342501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:06.344164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1864e170-78f8-441d-838f-eda37c1cd19a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.280450 Aug 03 18:51:06.345307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 54/111] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:06 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:51:06.561192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:06.562221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:06.569913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.570677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:06.571885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.572527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:06.741694 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:06.751182 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-06e5e5a0-6c30-41de-b653-a9f66e76b38d tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1314 microversion: 2.1 time: 0.194900 Aug 03 18:51:06.751763 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 58/112] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:06 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:06.911152 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:06.911943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:06.922334 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.923429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:06.924489 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:06.925206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:07.095319 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:07.108403 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1a55762f-79a9-4477-bdab-48e50e6c6dd2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.199986 Aug 03 18:51:07.110610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 55/113] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:06 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:07.333284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:07.333895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:07.343200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:07.343650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:07.344480 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:07.344921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:07.366216 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:07.366899 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:07.376633 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:07.377130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:07.377926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:07.378365 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:07.721392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:07.729077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-651cffd1-e60a-4447-8c8c-dcaa32aaa30d tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.399687 Aug 03 18:51:07.729661 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 59/114] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:07 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:07.774118 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:07.775535 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:07.785602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:07.786059 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:07.787035 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:07.787482 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:07.797681 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:07.807041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:07.809134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:07.811106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4b762f27-f0a3-4ec5-8af6-7a432cb9ab63 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.448040 Aug 03 18:51:07.825431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 56/115] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:07 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:51:08.066071 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:08.076953 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-55b6a0da-8729-49c3-aa02-c5eee6503937 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1501 microversion: 2.1 time: 0.306562 Aug 03 18:51:08.078545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 60/116] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:07 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:08.130578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:08.131200 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:08.142773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:08.144549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:08.146312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:08.149225 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:08.389484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:08.400832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f6db1863-c514-4b79-97ff-22e47f01c796 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.274422 Aug 03 18:51:08.403466 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 57/117] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:08 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:08.754695 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:08.755321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:08.771595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:08.771941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:08.775959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:08.776457 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:08.835688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:08.836201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:08.847463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:08.847814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:08.849704 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:08.851918 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:09.099960 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:09.111074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:09.121237 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:09.124816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:09.127157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a80e5b19-df73-4e1a-b4c6-19f3dd76c9f8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.295555 Aug 03 18:51:09.141401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 58/118] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:08 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:09.142403 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-42c70271-cbfa-4c2d-b4e3-d454579ad0c8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.396057 Aug 03 18:51:09.153351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 61/119] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:08 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:09.424259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:09.425041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:09.432707 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:09.433370 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:09.434412 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:09.435666 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:09.601907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:09.613764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8664831d-300a-474b-ac20-0d76de8b2774 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.193505 Aug 03 18:51:09.615750 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 59/120] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:09 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:09.868309 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-158e6f0c-1894-4cde-9afb-3f38f992e2b7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db24087b-4a42-439c-866b-ab8b2a538708"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:09.870965 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-158e6f0c-1894-4cde-9afb-3f38f992e2b7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:09.878655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-158e6f0c-1894-4cde-9afb-3f38f992e2b7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:09.879361 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-158e6f0c-1894-4cde-9afb-3f38f992e2b7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:09.880119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-158e6f0c-1894-4cde-9afb-3f38f992e2b7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:09.880586 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-158e6f0c-1894-4cde-9afb-3f38f992e2b7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:10.154737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:10.156319 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:10.163351 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:10.163930 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:10.164903 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:10.165418 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:10.358437 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:10.369690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:10.371587 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:10.373408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3e7d4f2e-acbb-4b28-9150-e1170aceeba1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.222742 Aug 03 18:51:10.374153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 60/121] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:10 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:51:10.378909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:10.379896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:10.385795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:10.386435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:10.387317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:10.387955 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:10.563048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:10.573639 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fd2b9eab-bd76-4444-9982-5dba769c61d8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.198167 Aug 03 18:51:10.574744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 61/122] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:10 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:10.636427 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:10.637389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:10.649823 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:10.652835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:10.656893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:10.657727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:10.921488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:10.931792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-575abc0b-75b1-43e5-ab18-55b698b15a65 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.299050 Aug 03 18:51:10.933517 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 62/123] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:10 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:11.189665 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-158e6f0c-1894-4cde-9afb-3f38f992e2b7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "POST /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.326236 Aug 03 18:51:11.190378 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 62/124] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 18:51:09 2022] POST /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace/os-volume_attachments => generated 194 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:11.382249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-c11dadc0-05e7-43a7-a0d6-7aba88dd3ade req-3193ca4b-23b4-4033-9737-040e79543264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800ff343-a07b-438f-9353-240b8ce592a9", "name": "network-vif-plugged", "status": "completed", "tag": "c4284c49-f7bf-4ba4-bb52-eab9c9c73389"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:11.399808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c11dadc0-05e7-43a7-a0d6-7aba88dd3ade req-3193ca4b-23b4-4033-9737-040e79543264 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:11.400772 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:11.401594 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:11.405869 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c11dadc0-05e7-43a7-a0d6-7aba88dd3ade req-3193ca4b-23b4-4033-9737-040e79543264 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:11.414869 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:11.423545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-c11dadc0-05e7-43a7-a0d6-7aba88dd3ade req-3193ca4b-23b4-4033-9737-040e79543264 service nova] Creating event network-vif-plugged:c4284c49-f7bf-4ba4-bb52-eab9c9c73389 for instance 800ff343-a07b-438f-9353-240b8ce592a9 on hv-cinder-85164 Aug 03 18:51:11.424089 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:11.425132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:11.425709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:11.437103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-c11dadc0-05e7-43a7-a0d6-7aba88dd3ade req-3193ca4b-23b4-4033-9737-040e79543264 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058460 Aug 03 18:51:11.438375 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 63/125] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:51:11.563828 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:11.571710 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:11.573255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:11.574362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b973da7a-0e41-4dc7-8562-21fe9b7cd0ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.182416 Aug 03 18:51:11.574922 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 63/126] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:11 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:51:11.596491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:11.597191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:11.603567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:11.604055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:11.604882 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:11.605391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:11.739160 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:11.746635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d4595b3f-ce39-4f57-a835-4c7b0c6e4329 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.154494 Aug 03 18:51:11.747213 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 64/127] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:11 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:11.953448 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:11.954066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:11.960721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:11.961168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:11.961926 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:11.962363 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:12.098806 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:12.106321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ec7e2688-b0ed-44b2-b5bb-7c20b74ed1c7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.157466 Aug 03 18:51:12.107392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 64/128] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:11 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:12.599235 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:12.599850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:12.605866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:12.606317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:12.607605 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:12.608040 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:12.737157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:12.744935 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:12.746442 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:12.748134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f3cb884f-ba32-47a8-ad48-04a4942a3e80 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.152222 Aug 03 18:51:12.748878 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 65/129] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:12 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:12.767146 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:12.767753 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:12.773820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:12.774267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:12.775019 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:12.775451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:12.910127 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:12.917730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3cedc192-d164-4082-8e2c-bcf130e69ea1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.154626 Aug 03 18:51:12.918313 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 65/130] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:12 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:13.126887 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:13.127504 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:13.133771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:13.134225 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:13.134983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:13.135421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:13.267671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:13.275643 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9527b5a0-8d53-48f7-abbe-012d5c215470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.152433 Aug 03 18:51:13.276222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 66/131] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:13 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:13.771050 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:13.771733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:13.778232 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:13.778687 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:13.779885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:13.780350 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:13.917270 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:13.925784 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:13.927295 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:13.928422 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-42a9f553-8aa2-47e8-8345-8a3da58f1134 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.161293 Aug 03 18:51:13.928991 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 66/132] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:13 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:13.942296 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:13.942917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:13.949066 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:13.949518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:13.950282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:13.951373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:14.079179 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:14.086566 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f028bea6-8157-4772-9ab4-c0027e70a385 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.148133 Aug 03 18:51:14.087131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 67/133] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:13 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:14.299925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:14.301702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:14.313045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:14.313931 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:14.315090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:14.315696 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:14.472667 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:14.480997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0774756e-1d80-454f-be5b-33f05c70dd2d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.186388 Aug 03 18:51:14.481581 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 67/134] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:14 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:14.950753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:14.951583 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:14.957824 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:14.958277 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:14.959059 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:14.959490 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:14.980040 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:15.097338 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:15.105197 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:15.106714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:15.107371 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:15.108260 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:15.108568 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d67689dc-bc2b-43d4-ab5e-16602ebcacd8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.161711 Aug 03 18:51:15.109143 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 68/135] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:14 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:15.114722 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:15.115160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:15.115911 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:15.116362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:15.135405 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:15.250040 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:15.257734 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-29c7e455-ea39-4d79-b7b9-8c056efd08a7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.154703 Aug 03 18:51:15.258301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 68/136] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:15 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:15.505502 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:15.506004 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:15.514437 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:15.516082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:15.517252 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:15.521242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:15.682688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:15.690985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cd3267f8-3a51-4b21-91c0-7c081b6e6713 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1321 microversion: 2.1 time: 0.189921 Aug 03 18:51:15.691552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 69/137] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:15 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:16.131588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:16.132244 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:16.139107 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.139749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.140554 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.140991 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.282756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:16.299242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:16.301426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:16.308268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.308983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.309903 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.311102 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.315626 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:16.320062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:16.321575 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-bbe3094f-d134-4817-8273-df58baab1fda tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.194253 Aug 03 18:51:16.322791 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 69/138] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:16 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:16.490284 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:16.500203 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ef86ac62-cfca-412a-8870-c798b6e3a12c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.224814 Aug 03 18:51:16.508433 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 70/139] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:16 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:16.711377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:16.711997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:16.718760 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.719206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.719998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.720466 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.850900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:16.858445 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-937ea373-92e8-48bc-a0d1-18e0f5971d4b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1514 microversion: 2.1 time: 0.151413 Aug 03 18:51:16.859013 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 70/140] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:16 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:16.879722 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:16.882077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:16.888690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.889721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.890472 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:16.890902 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:16.953497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lazy-loading 'flavor' on Instance uuid bab63b03-b37e-4d91-afa5-6b01ae41f2e6 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:51:17.079455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-efbdc083-abf0-4aed-b643-840789f4d491 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6/action" status: 200 len: 32 microversion: 2.1 time: 0.203902 Aug 03 18:51:17.080328 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 71/141] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:51:16 2022] POST /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 18:51:17.089273 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:17.089892 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:17.096149 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.096641 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.097401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.097837 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.229692 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:17.238061 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-69c8b88c-9fd9-4a6f-9bf1-c382d6afb80c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.152557 Aug 03 18:51:17.238627 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 71/142] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:17 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:17.347237 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:17.347928 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:17.354161 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.354603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.355359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.355792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.449208 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-727428621", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:17.503047 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:17.503221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] validate_networks() for None {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:51:17.515006 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:17.516832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:17.518017 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d7b4d636-affc-4f5e-80f9-c25dfa3fb740 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.174998 Aug 03 18:51:17.518580 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 72/143] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:17 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:51:17.522974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:17.523586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:17.530095 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.530548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.531311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.531751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.824980 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:17.833471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1333c13e-bd37-47e6-8f4c-d1b625369114 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.313878 Aug 03 18:51:17.834056 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 73/144] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:17 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:17.855601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:51:17.856027 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:51:17.856612 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:51:17.857227 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:51:17.857647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:51:17.859606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=89 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:17.868447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.868902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.869701 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:17.870137 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:17.887054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Getting quotas for project f15b6902ce664c0ba8fc4cb0868fdaa3. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:51:17.891602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Getting quotas for user f09070fbc0dc4486ae03bae2701fe85c and project f15b6902ce664c0ba8fc4cb0868fdaa3. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:51:17.902867 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:51:17.905834 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:51:17.948568 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5ae26514-bb05-43d9-8e40-c85639dda7c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503153 Aug 03 18:51:17.949228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 72/145] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 18:51:17.960394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6b16b5a5-9839-42e3-a4f0-c9236fa2b3a9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:17.961011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6b16b5a5-9839-42e3-a4f0-c9236fa2b3a9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:18.017888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6b16b5a5-9839-42e3-a4f0-c9236fa2b3a9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:18.025751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6b16b5a5-9839-42e3-a4f0-c9236fa2b3a9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1214 microversion: 2.1 time: 0.069209 Aug 03 18:51:18.027000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 74/146] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:17 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:18.260826 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:18.261439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:18.268625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:18.269076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:18.270011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:18.270513 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:18.402505 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:18.410582 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1c5501ee-14d4-4b13-a7d7-818ede5bf8f4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.154693 Aug 03 18:51:18.411148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 73/147] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:18 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:18.540975 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:18.541672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:18.548163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:18.548650 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:18.549544 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:18.549860 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:18.678653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:18.686683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:18.688185 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:18.689312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5b1f5ae8-ff84-4850-b0a2-fd2dda0b2bc3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.152352 Aug 03 18:51:18.689868 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 75/148] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:18 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:18.854205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:18.854882 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:18.860943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:18.861400 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:18.862160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:18.862596 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:18.996855 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:19.005004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0d3c639b-49b0-415e-b63f-bf217123adad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.154619 Aug 03 18:51:19.005581 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 74/149] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:18 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:19.048382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:19.048940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:19.054888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:19.055346 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:19.056114 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:19.056579 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:19.125274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:19.134508 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-af7775ce-d13a-41a4-8e37-56ea998d2d5b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1218 microversion: 2.1 time: 0.090808 Aug 03 18:51:19.135500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 76/150] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:19 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:19.433186 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:19.433715 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:19.440681 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:19.441126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:19.441910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:19.442339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:19.572083 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:19.580975 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4aec67b4-51c9-4ba0-911d-6ea7e7aa875d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.151529 Aug 03 18:51:19.581716 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 75/151] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:19 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:19.711190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:19.711812 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:19.721923 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:19.722488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:19.723350 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:19.724140 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:19.860039 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:19.867994 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:19.869548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:19.870649 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1c8aa614-1862-40c3-a8fa-8a17ce9e13b1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.163491 Aug 03 18:51:19.871206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 77/152] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:19 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:20.025231 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:20.025766 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:20.031943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.032427 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:20.033181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.033606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:20.156327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:20.156867 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:20.163063 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.163267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:20.163507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:20.164273 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.164727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:20.173502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a9ac0393-0545-4445-9107-e6c48f0d50cc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.152064 Aug 03 18:51:20.174174 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 76/153] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:20 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:20.230448 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:20.238468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-280de764-a388-43f3-8004-13e80547ae3a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1218 microversion: 2.1 time: 0.086031 Aug 03 18:51:20.239036 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 78/154] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:20 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:20.602394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:20.603009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:20.610577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.611071 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:20.611834 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.612273 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:20.750743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:20.758549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-bbaa3962-f034-493f-808b-69e6d559a4bb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.160095 Aug 03 18:51:20.759115 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 77/155] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:20 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:20.894106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:20.894704 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:20.900647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.901090 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:20.901829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:20.902255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:21.037029 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:21.045088 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:21.046589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:21.047677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fb1ff387-01e6-4186-ab51-eb05930ff9da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.157455 Aug 03 18:51:21.048229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 79/156] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:20 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:21.193360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:21.193963 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:21.200055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:21.200519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:21.201834 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:21.202259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:21.261982 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:21.262763 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:21.270409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:21.270950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:21.271817 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:21.272401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:21.343200 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:21.350602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d9ed1c70-ddaa-4e20-beb4-1ec1014c4a1d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1218 microversion: 2.1 time: 0.093330 Aug 03 18:51:21.351190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 80/157] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:21 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:21.366110 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:21.374094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f014e5d6-3167-45fc-a387-f9dc7415ccb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.184546 Aug 03 18:51:21.374657 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 78/158] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:21 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:21.780542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:21.781157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:21.787184 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:21.787634 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:21.788434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:21.788876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:21.923364 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:21.931201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f65e44ba-bc0b-4dec-bd63-6d1f59a6221b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.154704 Aug 03 18:51:21.932158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 81/159] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:21 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:22.070917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:22.071441 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:22.077468 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.077911 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.078657 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.079088 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.211971 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:22.222274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:22.223821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:22.224985 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-60b28b09-5a9b-4ff8-acf5-8f85851888da tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.158639 Aug 03 18:51:22.225859 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 79/160] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:22 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:22.375148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:22.377007 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:22.383800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.384276 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.385061 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.385508 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.394808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:22.395415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:22.402082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.402518 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.411240 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.411677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.490593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:22.498002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-13d0d8bc-1b68-46b8-9eaa-604e56a65bf3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1218 microversion: 2.1 time: 0.129092 Aug 03 18:51:22.498575 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 82/161] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:22 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:22.559897 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:22.569077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-78bb2375-b5fa-45ac-9d58-bc847fed7fb1 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.177960 Aug 03 18:51:22.570137 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 80/162] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:22 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:22.681123 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-704df36d-c3a8-4dba-8968-e349b9cdfbc3 req-7691215d-01e2-4150-9f81-51525ab35ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75afca33-3ec7-4c03-9d25-a247fc1e47bd", "name": "network-vif-plugged", "status": "completed", "tag": "1407aa85-6899-475c-a3c7-c06872937b88"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:22.692122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-704df36d-c3a8-4dba-8968-e349b9cdfbc3 req-7691215d-01e2-4150-9f81-51525ab35ad0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.692865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-704df36d-c3a8-4dba-8968-e349b9cdfbc3 req-7691215d-01e2-4150-9f81-51525ab35ad0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.705558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-704df36d-c3a8-4dba-8968-e349b9cdfbc3 req-7691215d-01e2-4150-9f81-51525ab35ad0 service nova] Creating event network-vif-plugged:1407aa85-6899-475c-a3c7-c06872937b88 for instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd on hv-cinder-85164 Aug 03 18:51:22.710524 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-704df36d-c3a8-4dba-8968-e349b9cdfbc3 req-7691215d-01e2-4150-9f81-51525ab35ad0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033044 Aug 03 18:51:22.711479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 83/163] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:22.952501 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:22.953126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:22.960352 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.960733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:22.961574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:22.962049 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:23.103738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:23.112554 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1a23bcf9-c32d-4021-abb0-48d94ea7d667 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.164401 Aug 03 18:51:23.113163 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 81/164] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:22 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:23.252353 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:23.253383 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:23.269613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:23.269613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:23.269613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:23.269613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:23.422494 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:23.427272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:23.433249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:23.434790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:23.436082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-46dfcd96-33de-4fb0-ae6f-9ad1d3def230 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.190152 Aug 03 18:51:23.436774 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 84/165] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:23 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:23.518903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:23.519975 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:23.527871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:23.528516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:23.530270 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:23.530892 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:23.593830 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:23.595463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:23.614620 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:23.615577 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:23.619249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:23.619964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:23.676223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:23.684924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b1ecb398-b713-4f6c-864e-73cb861320e3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1218 microversion: 2.1 time: 0.169999 Aug 03 18:51:23.688550 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 82/166] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:23 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:23.815189 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:23.823476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4c2a67c6-3ef0-4fc7-b50b-9037dc28c564 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.236310 Aug 03 18:51:23.824051 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 85/167] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:23 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:24.137071 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:24.138113 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:24.150044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.150787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:24.152048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.152790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:24.303966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:24.313028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2c863c01-289a-4be2-b694-7a3eb26ff7a5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.182104 Aug 03 18:51:24.313825 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 83/168] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:24 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:24.458167 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:24.458785 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:24.461680 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:24.467580 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.468029 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:24.469087 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.469531 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:24.617200 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:24.627907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:24.629774 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:24.630891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3e5a6f10-fe7c-4e77-9768-44d3c84f46b9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.176624 Aug 03 18:51:24.631545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 86/169] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:24 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:24.707024 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:24.707650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:24.716330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.716786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:24.717659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.718155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:24.792508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:24.802936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-36f902dc-a60c-4818-b6c7-7f320783da8f tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1210 microversion: 2.1 time: 0.100113 Aug 03 18:51:24.803815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 84/170] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:24 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:24.847309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:24.847936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:24.854109 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.854556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:24.855315 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:24.855749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:25.035506 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:25.046304 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4b0f3c3e-158f-470b-afdb-75bae04735ad tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.203017 Aug 03 18:51:25.059433 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 87/171] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:24 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:25.337940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:25.338788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:25.347223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:25.348636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:25.348982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:25.349751 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:25.555358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:25.559473 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:25.565273 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b082439e-0aea-434f-b424-a46e3ecb209d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.232898 Aug 03 18:51:25.569559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 85/172] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:25 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:25.659803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:25.661995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:25.685875 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:25.687729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:25.689964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:25.691807 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:25.829296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:25.830838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:25.841325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:25.842511 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:25.843672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:25.844410 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:26.104746 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:26.113924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-525f7f4e-56fb-4b19-8523-9e5cd9f3d690 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1266 microversion: 2.1 time: 0.292106 Aug 03 18:51:26.114650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 86/173] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:25 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:26.119506 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:26.120384 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:26.138302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:26.139040 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:26.140075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:26.140768 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:26.316998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:26.328714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:26.333435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:26.335420 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-18a5e0d0-6dba-466a-9bcc-07c02ce9fe79 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.683201 Aug 03 18:51:26.336949 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 88/174] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:25 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:26.407213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:26.415074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ff3e9f91-f094-431f-b52f-3170cf68dcd6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1363 microversion: 2.1 time: 0.299228 Aug 03 18:51:26.415886 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 87/175] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:26 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:26.595042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:26.596821 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:26.605401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:26.606326 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:26.608107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:26.608954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:26.764243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:26.772062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-93dfe63b-32fc-4869-8231-b277c1d050e8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.184327 Aug 03 18:51:26.772858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 89/176] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:26 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:27.136187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:27.136939 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:27.144366 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.144918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.146336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.146925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.221090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:27.229694 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a83b1789-b6b7-4abf-975c-b116f48923fc tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1274 microversion: 2.1 time: 0.097716 Aug 03 18:51:27.232031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 88/177] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:27 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:27.359240 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:27.359860 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:27.367285 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.367808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.369829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.370491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.437236 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:27.437860 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:27.444660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.445343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.446111 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.446878 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.672972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:27.684796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:27.687705 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:27.689249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1b379318-3334-48c2-ab11-3da894f70ee4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.334152 Aug 03 18:51:27.690426 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 90/178] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:27 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:27.719310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:27.727611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ac6cbeec-e566-4b4b-9b98-f0ba35cea06a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1548 microversion: 2.1 time: 0.295284 Aug 03 18:51:27.728199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 89/179] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:27 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1548 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:27.753329 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dc9155b0-93d9-477e-ab35-0792ca5ae120 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:27.753845 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-dc9155b0-93d9-477e-ab35-0792ca5ae120 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:27.761576 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc9155b0-93d9-477e-ab35-0792ca5ae120 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.762275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc9155b0-93d9-477e-ab35-0792ca5ae120 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.764086 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc9155b0-93d9-477e-ab35-0792ca5ae120 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.765031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc9155b0-93d9-477e-ab35-0792ca5ae120 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.799036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:27.799659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:27.806112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.806564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.807576 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:27.807925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:27.878306 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:27.897956 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:27.919685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-dc9155b0-93d9-477e-ab35-0792ca5ae120 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172193 Aug 03 18:51:27.922083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 91/180] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 18:51:27 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:28.208053 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:28.220484 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f2d18726-9fda-4307-8da4-6710ed1b3b61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.426916 Aug 03 18:51:28.221616 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 90/181] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:27 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:28.248720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:28.253614 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:28.254851 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:28.262550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:28.263188 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:28.265099 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:28.265697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:28.372064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:28.385382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4d06cd7d-5219-4a79-9350-4102ecc9f3d5 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1274 microversion: 2.1 time: 0.136821 Aug 03 18:51:28.400383 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 92/182] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:28 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:28.716232 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:28.718775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:28.735564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:28.736402 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:28.737395 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:28.740022 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:29.245241 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:29.246735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:29.256784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:29.257749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:29.259990 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:29.260863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:29.490059 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:29.504631 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:29.508851 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:29.512993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e7430206-1a83-4d50-97b8-f1369b6e97c5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1407 microversion: 2.20 time: 0.803919 Aug 03 18:51:29.515419 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 91/183] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:28 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1407 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:29.533397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:29.534131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:29.550906 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:29.551364 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:29.552150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:29.554432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:29.788460 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:29.800725 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ac08dfa5-dfbd-42d2-b9fc-4d89fa4e3926 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1272 microversion: 2.1 time: 0.283409 Aug 03 18:51:29.801600 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 92/184] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:29 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1272 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:29.839553 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:29.849445 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6e6a4a29-e947-4084-a2df-6c8f9264bc91 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.608994 Aug 03 18:51:29.850477 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 93/185] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:29 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:30.539817 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:30.540456 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:30.554339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:30.555022 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:30.556007 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:30.556650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:30.641667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-c5cca507-afa9-4f51-81f0-3496cb51dace req-77ab39c7-6769-4475-9354-14a90f1e89dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800ff343-a07b-438f-9353-240b8ce592a9", "tag": "c4284c49-f7bf-4ba4-bb52-eab9c9c73389"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:30.680560 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c5cca507-afa9-4f51-81f0-3496cb51dace req-77ab39c7-6769-4475-9354-14a90f1e89dd service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:30.681035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c5cca507-afa9-4f51-81f0-3496cb51dace req-77ab39c7-6769-4475-9354-14a90f1e89dd service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:30.720841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-c5cca507-afa9-4f51-81f0-3496cb51dace req-77ab39c7-6769-4475-9354-14a90f1e89dd service nova] Creating event network-changed:c4284c49-f7bf-4ba4-bb52-eab9c9c73389 for instance 800ff343-a07b-438f-9353-240b8ce592a9 on hv-cinder-85164 Aug 03 18:51:30.731148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-c5cca507-afa9-4f51-81f0-3496cb51dace req-77ab39c7-6769-4475-9354-14a90f1e89dd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094520 Aug 03 18:51:30.731841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 94/186] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:30.830578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:30.833310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:30.854164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:30.854623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:30.855408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:30.855843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:31.018514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:31.020786 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:31.043024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-34cbb019-41ed-4e4c-8635-09ba73605dc7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1272 microversion: 2.1 time: 0.224061 Aug 03 18:51:31.054967 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:31.057836 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:31.058636 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 95/187] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:30 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:31.062148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-97506a36-75a6-4983-a072-1ca8fbda283a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1598 microversion: 2.20 time: 0.526302 Aug 03 18:51:31.072343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 93/188] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:51:30 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1598 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:51:31.082281 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:31.083082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:31.090259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:31.090860 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fd945b98-c753-4768-967c-b19527781722 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:31.091931 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fd945b98-c753-4768-967c-b19527781722 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:31.094607 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:31.095486 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:31.095938 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:31.101204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd945b98-c753-4768-967c-b19527781722 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:31.101671 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd945b98-c753-4768-967c-b19527781722 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:31.102560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd945b98-c753-4768-967c-b19527781722 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:31.112071 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd945b98-c753-4768-967c-b19527781722 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:31.356483 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fd945b98-c753-4768-967c-b19527781722 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.272020 Aug 03 18:51:31.358212 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 94/189] 10.222.0.69 () {60 vars in 1316 bytes} [Wed Aug 3 18:51:31 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:51:31.483696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:31.497191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9ee9ed1a-fb6f-4ce6-8fdd-752a11daccdd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.437149 Aug 03 18:51:31.498214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 96/190] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:31 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:32.082654 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:32.083625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:32.090929 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:32.091798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:32.092890 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:32.093868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:32.339879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:32.361360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-35b78f4f-622e-49f7-8c32-d0e8ae685141 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.285667 Aug 03 18:51:32.362179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 95/191] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:32 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:32.523603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:32.524924 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:32.533369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:32.534155 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:32.534959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:32.535556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:32.727217 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:32.736147 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-07caca4f-7492-4d6b-b394-7cdbd9cf95a3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.217853 Aug 03 18:51:32.751217 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 97/192] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:32 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:33.082248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-9dfe55b8-11a6-4af7-893c-cd35b47d2853 req-364e5f43-55ef-4c3e-96e3-7df9c3b29a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75afca33-3ec7-4c03-9d25-a247fc1e47bd", "tag": "1407aa85-6899-475c-a3c7-c06872937b88"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:33.094625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9dfe55b8-11a6-4af7-893c-cd35b47d2853 req-364e5f43-55ef-4c3e-96e3-7df9c3b29a70 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:33.095267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9dfe55b8-11a6-4af7-893c-cd35b47d2853 req-364e5f43-55ef-4c3e-96e3-7df9c3b29a70 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:33.110776 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-9dfe55b8-11a6-4af7-893c-cd35b47d2853 req-364e5f43-55ef-4c3e-96e3-7df9c3b29a70 service nova] Creating event network-changed:1407aa85-6899-475c-a3c7-c06872937b88 for instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd on hv-cinder-85164 Aug 03 18:51:33.115994 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-9dfe55b8-11a6-4af7-893c-cd35b47d2853 req-364e5f43-55ef-4c3e-96e3-7df9c3b29a70 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037476 Aug 03 18:51:33.116982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 96/193] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:33.383372 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:33.383991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:33.403992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:33.404910 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:33.405808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:33.406254 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:33.550025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:33.559242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-21914be0-9d34-4a4d-96ed-5ead287401f8 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.179943 Aug 03 18:51:33.561125 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 98/194] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:33 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:33.761212 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:33.761943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:33.772326 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:33.772859 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:33.773790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:33.774230 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:34.056180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:34.065034 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e0c607d6-a1ee-49e7-8c43-9884618195e3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.308249 Aug 03 18:51:34.065877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 97/195] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:33 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:34.418219 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-8a25dbc9-bc3e-4852-9246-6973c9c96b3a req-91ef5c1f-d211-40f2-b266-1554cbb5f41b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad786b70-63b3-4116-b230-d1dc7959adeb", "tag": "eeb518e0-b830-4ed6-87dd-e9b16f11a9d1"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:34.430624 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8a25dbc9-bc3e-4852-9246-6973c9c96b3a req-91ef5c1f-d211-40f2-b266-1554cbb5f41b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:34.431127 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8a25dbc9-bc3e-4852-9246-6973c9c96b3a req-91ef5c1f-d211-40f2-b266-1554cbb5f41b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:34.446411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-8a25dbc9-bc3e-4852-9246-6973c9c96b3a req-91ef5c1f-d211-40f2-b266-1554cbb5f41b service nova] Creating event network-changed:eeb518e0-b830-4ed6-87dd-e9b16f11a9d1 for instance ad786b70-63b3-4116-b230-d1dc7959adeb on hv-cinder-85164 Aug 03 18:51:34.453396 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-8a25dbc9-bc3e-4852-9246-6973c9c96b3a req-91ef5c1f-d211-40f2-b266-1554cbb5f41b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039941 Aug 03 18:51:34.454077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 99/196] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:34.583962 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:34.584815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:34.592016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:34.592748 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:34.593439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:34.593900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:35.087876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:35.088699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:35.100932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:35.102459 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:35.103848 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:35.105519 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:35.274113 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:35.282032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cb191492-01fc-4201-bff7-b85104214bea tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.703274 Aug 03 18:51:35.282629 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 98/197] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:34 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:35.287255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:35.287928 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:35.298497 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:35.298959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:35.299895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:35.300369 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:35.328667 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:51:35.433248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e0ca06c3-835b-42c6-bbc1-b691b72ba205 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "DELETE /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 204 len: 0 microversion: 2.1 time: 0.149203 Aug 03 18:51:35.433973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 99/198] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:51:35 2022] DELETE /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:51:35.443281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:35.443916 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:35.450152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:35.451217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:35.452086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:35.452563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:35.486661 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:35.494434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c4cce0ff-8051-4b29-88de-9e715b2baefb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.410855 Aug 03 18:51:35.495012 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 100/199] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:35 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:35.621579 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:35.630775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1e0e7233-4db5-4931-8f42-5df1da8c8490 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.191911 Aug 03 18:51:35.631342 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 100/200] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:35 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:36.303484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:36.304091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:36.310881 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:36.311572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:36.312364 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:36.312802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:36.443214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:36.451554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5d16729f-a8f2-4293-b044-9575fb304d4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.151063 Aug 03 18:51:36.452156 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 101/201] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:36 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:36.517153 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:36.517798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:36.523999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:36.524495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:36.525260 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:36.525698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:36.652370 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:36.652905 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:36.659464 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:36.659941 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:36.660732 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:36.661162 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:36.664412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:36.667993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:36.674760 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8ce11251-171e-42ba-8b5a-a4228ed1832b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.161672 Aug 03 18:51:36.675456 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 101/202] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:36 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:36.793124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:36.801238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-81b20efb-cee1-4ace-b758-74a34dc7ab5e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.152853 Aug 03 18:51:36.801806 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 102/203] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:36 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:37.472836 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:37.473485 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:37.480821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:37.481271 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:37.482528 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:37.482961 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:37.614036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:37.621389 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-78d56a2a-b41b-4c19-9837-c8ac45df07be tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.153207 Aug 03 18:51:37.621962 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 102/204] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:37 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:37.696781 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:37.697518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:37.703658 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:37.704109 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:37.705015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:37.705454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:37.709522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:37.834872 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:37.835644 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:37.843064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:37.843513 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:37.844320 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:37.844752 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:37.859047 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:37.866482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3759c76b-76b9-4938-a33b-64de578c2e1c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.173879 Aug 03 18:51:37.867047 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 103/205] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:37 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:37.977738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:37.986419 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ad2e94ef-3ca6-4653-b738-abf4cb78c812 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.155589 Aug 03 18:51:37.986984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 103/206] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:37 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:38.642373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:38.642988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:38.649107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:38.649557 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:38.650316 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:38.650754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:38.788146 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:38.795603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0aa05e63-1608-4334-be09-8af54462f358 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.157085 Aug 03 18:51:38.796169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 104/207] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:38 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:38.889530 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:38.890166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:38.897516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:38.897963 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:38.898721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:38.899152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:39.007827 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:39.008487 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:39.015043 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:39.015492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:39.016253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:39.016768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:39.031563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:39.039190 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-09fef0c4-7e60-4cc6-9ee7-6e78019ba58c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.154641 Aug 03 18:51:39.039757 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 104/208] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:38 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:39.157257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:39.165377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ceb839b9-5158-4f5e-bc77-015e023aed66 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.161655 Aug 03 18:51:39.165961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 105/209] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:39 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:39.815886 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:39.816685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:39.822879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:39.823330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:39.824096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:39.824612 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:39.959739 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:39.967173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-03c0a461-e189-40a2-afd2-7d52b7ddf6bd tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.155336 Aug 03 18:51:39.967742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 105/210] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:39 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:40.060696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:40.061310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:40.067303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:40.067757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:40.068547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:40.068987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:40.201138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:40.201757 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:40.208030 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:40.208743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:40.209578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:40.210080 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:40.211437 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:40.219444 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2346af8e-1927-42f7-9c70-31844fa2d6ff tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.163077 Aug 03 18:51:40.220122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 106/211] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:40 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:40.351812 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:40.361531 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c2d030a8-4b70-4564-af56-c66bd5c532ab tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.164875 Aug 03 18:51:40.362111 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 106/212] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:40 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:40.988863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:40.989470 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:40.995484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:40.995932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:40.996721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:40.997171 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:41.126333 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:41.134047 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-da053b01-d5ac-4490-bb0e-126f7e1b6999 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.148996 Aug 03 18:51:41.134609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 107/213] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:40 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:41.242345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:41.243565 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:41.250192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:41.250853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:41.251900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:41.252373 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:41.383045 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:41.383668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:41.390362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:41.391079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:41.391534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:41.392327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:41.392770 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:41.398041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-410d8f31-4587-42f3-bb43-40385e570cae tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.159530 Aug 03 18:51:41.398620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 107/214] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:41 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:41.524613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:41.532888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4df697d8-0a80-40ea-a80b-5942002ea1fc tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.154014 Aug 03 18:51:41.533469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 108/215] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:41 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:42.154848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:42.156055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:42.161808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:42.162336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:42.163181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:42.163621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:42.419389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:42.420158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:42.425943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:42.426393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:42.427155 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:42.427589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:42.509387 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:42.517735 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cf2b9bab-8411-427d-b68c-4a14818cd7c2 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.366776 Aug 03 18:51:42.518343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 108/216] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:42 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:42.553873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:42.554781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:42.563742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:42.564440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:42.565541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:42.566156 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:42.675267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:42.683441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-617ea4f5-d143-45e5-be36-93e4ecce2687 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.268183 Aug 03 18:51:42.684053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 109/217] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:42 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:42.793447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:42.802025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f948effa-8537-424f-8d60-49507786e902 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.252075 Aug 03 18:51:42.802638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 109/218] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:42 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:43.541580 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:43.542237 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:43.550657 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:43.551112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:43.551895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:43.552362 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:43.698191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:43.705125 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:43.705742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:43.706875 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a33c3500-090b-4d95-a15d-10f2249d1c38 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.169216 Aug 03 18:51:43.707811 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 110/219] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:43 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:43.712557 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:43.713207 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:43.714128 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:43.715063 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:43.827325 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:43.827940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:43.834095 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:43.834555 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:43.835337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:43.835776 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:43.850522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:43.858027 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-52a377e5-4a90-452b-acd8-9c0f1fe903f8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.157531 Aug 03 18:51:43.858599 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 110/220] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:43 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:43.971015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:43.979773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-717be2b5-3e10-4850-b7af-e34ccc8b8065 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.156849 Aug 03 18:51:43.986303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 111/221] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:43 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:44.728029 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:44.728682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:44.736116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:44.736595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:44.737361 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:44.737799 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:44.869789 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:44.878047 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-975685ad-d60a-4430-bcb3-d2bea14afd4a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.153853 Aug 03 18:51:44.878627 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 111/222] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:44 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:44.880033 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:44.880755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:44.886851 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:44.887342 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:44.888125 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:44.888588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:45.001747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:45.002367 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:45.009096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:45.009553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:45.010324 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:45.010767 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:45.021913 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:45.030151 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4fb21b9b-7e77-4425-9bba-889938e4b9b7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.154644 Aug 03 18:51:45.040332 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 112/223] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:44 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:45.141772 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:45.149668 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-79969612-34c2-427c-8a1f-a4a76755a145 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.153006 Aug 03 18:51:45.150240 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 112/224] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:44 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:45.899410 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:45.900201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:45.907931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:45.908498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:45.909460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:45.909890 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:46.044934 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:46.051029 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:46.051640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:46.052761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1547d70b-b132-4db3-adc2-43e7394b0815 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.157642 Aug 03 18:51:46.053348 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 113/225] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:45 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:46.054161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:46.060214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:46.060774 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:46.061580 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:46.062016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:46.171840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:46.172780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:46.179309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:46.179851 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:46.180782 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:46.181251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:46.199575 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:46.208187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4d41a585-fcd1-4ad3-bb07-4f7c2b795c75 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.160920 Aug 03 18:51:46.208788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 113/226] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:46 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:46.322986 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:46.331196 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c4883ea9-b72d-41d3-be67-fd78ab85c5b5 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.163603 Aug 03 18:51:46.331768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 114/227] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:46 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:47.074418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:47.075024 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:47.082945 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:47.083390 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:47.084175 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:47.084635 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:47.213450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:47.221494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-77fbeae4-8cc9-455f-87da-35d686f16d83 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.150899 Aug 03 18:51:47.222191 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 114/228] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:47 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:47.228432 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:47.229128 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:47.235876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:47.235876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:47.236710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:47.237148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:47.352413 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:47.353203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:47.360118 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:47.360674 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:47.361521 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:47.362043 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:47.376714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:47.384532 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9cbf087d-3eb4-4dc6-b6e2-1a6f5f92f1c9 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.159843 Aug 03 18:51:47.385102 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 115/229] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:47 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:47.505073 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:47.513847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-98d7f2dc-fea7-4c47-89b3-dc0e72653409 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.165375 Aug 03 18:51:47.514429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 115/230] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:47 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:48.242154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:48.242762 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:48.249171 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:48.249615 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:48.250376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:48.251104 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:48.384222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:48.391945 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-203cf931-1e05-419b-8f16-be1c10c6584c tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.153636 Aug 03 18:51:48.392546 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 116/231] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:48 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:48.406713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:48.407324 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:48.413974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:48.414519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:48.415326 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:48.415769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:48.535894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:48.536547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:48.543213 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:48.544050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:48.545231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:48.545671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:48.745849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:48.754616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0374c786-795f-4158-ac26-d393cc4e9a8b tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.222640 Aug 03 18:51:48.755408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 117/232] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:48 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:48.757067 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:48.765447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-65729561-7c67-4204-bb6e-1efad4d80f7a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.363240 Aug 03 18:51:48.766013 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 116/233] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:48 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:49.413046 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:49.413662 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:49.420214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:49.421059 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:49.422467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:49.423284 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:49.561382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:49.568859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7d049096-12df-4f49-a90d-fd33902b73b3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.159739 Aug 03 18:51:49.569427 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 118/234] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:49 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:49.776365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:49.777063 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:49.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:49.784450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:49.785213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:49.785651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:49.786087 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:49.786701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:49.792747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:49.793191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:49.793946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:49.794875 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:49.982892 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:49.986276 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:49.989640 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:49.991096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dced93fc-ae41-4d75-96ce-3527a36ad6ac tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.219059 Aug 03 18:51:49.991917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 117/235] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:49 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:49.994940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-63336ee2-8693-4189-9881-1357e1f3cc19 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.212667 Aug 03 18:51:49.995547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 119/236] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:49 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:50.590303 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:50.591488 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:50.597763 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:50.598266 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:50.599061 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:50.599561 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:50.618006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:50.730726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:50.739243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-17ed918b-dbd3-4b5e-9297-efdcddb53fe1 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.152687 Aug 03 18:51:50.739815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 118/237] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:50 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:51.013333 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:51.014269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:51.017750 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:51.018368 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:51.020573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:51.021030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:51.021808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:51.022244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:51.024785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:51.025242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:51.026015 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:51.026452 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:51.220064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:51.224317 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:51.228178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c962153b-0c4a-4995-bb53-b5d9206d1cc1 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.219326 Aug 03 18:51:51.228785 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 120/238] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:51 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:51.231888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a52cde0f-9f15-4cd3-90a6-4645c6102925 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.218172 Aug 03 18:51:51.232474 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 119/239] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:51 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:51.759097 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:51.759700 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:51.766052 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:51.766587 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:51.767342 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:51.767768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:51.899458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:51.907504 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d2140e2f-6777-4a66-999f-3170900c958b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.152203 Aug 03 18:51:51.908076 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 121/240] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:51 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:52.248941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:52.249566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:52.253227 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:52.253829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:52.256454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:52.256908 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:52.257682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:52.258118 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:52.260058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:52.260529 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:52.261275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:52.261707 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:52.465792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:52.470473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:52.474512 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6aedaace-0ba9-4926-b851-c87247388503 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.229463 Aug 03 18:51:52.475100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 120/241] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:52 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:52.477897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-841034a1-56fc-498d-9ed5-24ad25f4d64a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.228288 Aug 03 18:51:52.478462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 122/242] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:52 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:52.929873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:52.930489 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:52.937448 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:52.937902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:52.938673 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:52.939107 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:53.081747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:53.089416 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ea779766-b2ed-465d-9ce5-8c56d405ca4b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.164645 Aug 03 18:51:53.089981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 121/243] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:52 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:53.497413 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:53.499144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:53.500703 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:53.501871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:53.505538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:53.506184 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:53.506951 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:53.507389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:53.509266 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:53.509846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:53.510616 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:53.511055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:53.716086 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:53.719920 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:53.726221 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-393e675b-eb5c-43cf-be7e-cd6b3054c378 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.234146 Aug 03 18:51:53.740883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-db48ad1d-41d0-4768-a92d-6704b6cc1701 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.232782 Aug 03 18:51:53.740883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 122/244] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:53 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:53.741437 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 123/245] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:53 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:54.112943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:54.113565 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:54.121212 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:54.121844 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:54.123103 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:54.123696 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:54.632443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:54.654432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d57e492e-15e1-4b48-b9f7-b2d53a76e0c6 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.546000 Aug 03 18:51:54.664575 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 123/246] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:54 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:54.753776 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:54.756383 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:54.757721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:54.759647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:54.773368 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=75 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:51:54.775447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:54.776246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:54.777301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:54.777737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:54.778648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:54.780211 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:54.780735 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:54.782535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:55.110563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:55.120593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:55.121570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5bdba921-0cd4-4773-bb16-43bc56e2859d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.371569 Aug 03 18:51:55.122691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 124/247] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:54 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:55.134408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1c0d84ad-1c48-4561-8fe1-bf28f2ec5847 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1553 microversion: 2.1 time: 0.388292 Aug 03 18:51:55.135468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 124/248] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:54 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1553 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:55.274367 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-a359314b-123b-448a-aa04-abbe5b133df5 req-1da74d28-a8a3-44ed-ab00-5f6bf80d4f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44a440b7-980a-4d76-9813-92f7ac63eace", "name": "network-vif-deleted", "tag": "152f3dd3-5003-42f8-b1bd-b9b7d951effd"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:51:55.315954 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-a359314b-123b-448a-aa04-abbe5b133df5 req-1da74d28-a8a3-44ed-ab00-5f6bf80d4f17 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:55.316425 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-a359314b-123b-448a-aa04-abbe5b133df5 req-1da74d28-a8a3-44ed-ab00-5f6bf80d4f17 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:55.356160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-a359314b-123b-448a-aa04-abbe5b133df5 req-1da74d28-a8a3-44ed-ab00-5f6bf80d4f17 service nova] Creating event network-vif-deleted:152f3dd3-5003-42f8-b1bd-b9b7d951effd for instance 44a440b7-980a-4d76-9813-92f7ac63eace on hv-cinder-85164 Aug 03 18:51:55.363078 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-a359314b-123b-448a-aa04-abbe5b133df5 req-1da74d28-a8a3-44ed-ab00-5f6bf80d4f17 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091907 Aug 03 18:51:55.364357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 125/249] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:51:55.676335 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:55.676950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:55.682804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:55.683247 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:55.683997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:55.684455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:55.833642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:55.844013 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9c017817-c07b-4232-a733-b9018d287bb0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.171252 Aug 03 18:51:55.844447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 125/250] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:55 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:56.145040 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:56.145850 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:56.152138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:56.152715 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:56.156592 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:56.157381 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:56.157492 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:56.157922 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:56.163567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:56.164387 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:56.165169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:56.165609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:56.251150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:56.259816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6a5d0532-eb94-4b84-9f2a-6166f56e4702 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1345 microversion: 2.1 time: 0.108032 Aug 03 18:51:56.260395 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 126/251] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:56 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:51:56.353740 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:56.362464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-15d872e6-643e-4cc3-9931-21f6e3cdb91f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.222381 Aug 03 18:51:56.363145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 126/252] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:56 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:56.864610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:56.865236 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:56.871731 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:56.872194 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:56.873796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:56.874174 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:57.031469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:57.039958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e8c71128-18d8-4913-9bfd-3458f512d6b9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.179081 Aug 03 18:51:57.040948 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 127/253] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:56 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:57.281187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:57.281797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:57.289103 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:57.289558 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:57.290458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:57.290903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:57.356315 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:57.364982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-aecd32e6-43ee-4186-8539-380a6b706c9e tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1345 microversion: 2.1 time: 0.087687 Aug 03 18:51:57.365556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 127/254] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:57 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:57.385105 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:57.385814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:57.393010 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:57.393500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:57.394380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:57.394820 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:57.540345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:57.549027 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-640044a1-7cda-46a5-ac09-67b92e572da2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.168014 Aug 03 18:51:57.549606 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 128/255] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:57 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:58.061010 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:58.061620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:58.067741 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:58.068191 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:58.069001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:58.069437 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:58.200127 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:58.208282 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dc7c9dbf-1858-4f0b-abf9-4e070755f7bb tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.151521 Aug 03 18:51:58.208877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 128/256] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:58 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:58.386599 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:58.387205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:58.394588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:58.395031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:58.395776 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:58.396205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:58.458072 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:58.466030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-badc6a6c-0819-47c5-8b62-c3cf2e149adb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1345 microversion: 2.1 time: 0.083263 Aug 03 18:51:58.467196 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 129/257] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:58 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:58.570254 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:58.570864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:58.578081 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:58.578539 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:58.579290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:58.579726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:58.718473 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:58.725988 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ab5ee716-9a7c-4f1c-99ce-5b6596bb4aaa tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.159597 Aug 03 18:51:58.726548 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 129/258] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:58 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:59.229207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:59.229835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:59.236789 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:59.237227 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:59.237975 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:59.238401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:59.371670 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:59.380183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0a9ed969-d0a5-42c7-a623-823e612d7719 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.154768 Aug 03 18:51:59.380810 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 130/259] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:59 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:59.487708 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:59.488368 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:59.494870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:59.495321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:59.496081 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:59.496548 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:59.558469 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:59.567590 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-893ab086-c990-45a7-9592-a01737e06fbd tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1345 microversion: 2.1 time: 0.083727 Aug 03 18:51:59.568192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 130/260] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:59 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:51:59.748931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:51:59.749465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:51:59.755630 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:59.756083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:59.756884 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:51:59.757317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:51:59.893246 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:51:59.900483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9fb52aaa-a2f7-4368-b867-623a3c8bd42e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.156774 Aug 03 18:51:59.901043 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 131/261] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:51:59 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:00.401412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:00.401930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:00.409840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:00.410290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:00.411064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:00.411504 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:00.558973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:00.566740 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-eab24e3c-724b-4f79-a48c-31304bcca4d3 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.169333 Aug 03 18:52:00.567311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 131/262] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:00 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:00.589732 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:00.590553 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:00.597934 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:00.598383 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:00.599154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:00.599592 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:00.664935 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:00.673189 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-73e4bba3-b55c-45c2-9ef0-7f9f1ca531b4 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1345 microversion: 2.1 time: 0.087249 Aug 03 18:52:00.673757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 132/263] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:00 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:00.921908 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:00.922568 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:00.928650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:00.929110 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:00.929895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:00.930313 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:01.063080 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:01.070585 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-28f04a51-411b-4ded-a35e-143062daab62 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.152629 Aug 03 18:52:01.071152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 132/264] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:00 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:01.589097 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:01.589741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:01.596839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:01.597314 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:01.598061 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:01.598497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:01.694041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:01.694652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:01.701430 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:01.701883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:01.702651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:01.703085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:01.728272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:01.737131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ca1dfad4-08f9-4bfc-986b-4f2c28fb81f0 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.152712 Aug 03 18:52:01.737711 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 133/265] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:01 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:01.768970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:01.776886 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a6274273-2108-4ccc-9420-c9894ee5741a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1345 microversion: 2.1 time: 0.086796 Aug 03 18:52:01.777450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 133/266] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:01 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:02.092838 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:02.093476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:02.100093 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:02.100567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:02.101331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:02.101823 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:02.233655 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:02.241380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d717053e-a4f7-4f7d-970b-29b4bcdede33 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.153055 Aug 03 18:52:02.241945 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 134/267] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:02 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:02.758354 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:02.758972 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:02.769215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:02.769700 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:02.771327 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:02.771771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:02.805078 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:02.805699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:02.813031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:02.813519 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:02.814298 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:02.814736 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:02.876984 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:02.877609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:02.878224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lazy-loading 'fault' on Instance uuid 44a440b7-980a-4d76-9813-92f7ac63eace {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:52:02.979820 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f99fcc5eddd45c89abca70f00ad6fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ad699f792e4c50a898079291f09254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:02.986091 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:02.989256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c59eefb6-1fe1-4e98-9f95-6a6fa77cdcdb tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 200 len: 1350 microversion: 2.1 time: 0.189002 Aug 03 18:52:02.989857 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 135/268] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:02 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 1350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:03.000538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-b56fc850-8ce1-44bb-990f-5a07244698cb req-2612bce0-330a-4d60-9fa9-3b277c7f5da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad786b70-63b3-4116-b230-d1dc7959adeb", "name": "network-vif-plugged", "status": "completed", "tag": "eeb518e0-b830-4ed6-87dd-e9b16f11a9d1"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:03.008315 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-182c6f42-ef75-4092-af7a-a7aabcacd016 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.254148 Aug 03 18:52:03.009036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 134/269] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:02 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:03.011217 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-b56fc850-8ce1-44bb-990f-5a07244698cb req-2612bce0-330a-4d60-9fa9-3b277c7f5da4 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:03.011747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-b56fc850-8ce1-44bb-990f-5a07244698cb req-2612bce0-330a-4d60-9fa9-3b277c7f5da4 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:03.015658 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:03.025397 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-b56fc850-8ce1-44bb-990f-5a07244698cb req-2612bce0-330a-4d60-9fa9-3b277c7f5da4 service nova] Creating event network-vif-plugged:eeb518e0-b830-4ed6-87dd-e9b16f11a9d1 for instance ad786b70-63b3-4116-b230-d1dc7959adeb on hv-cinder-85164 Aug 03 18:52:03.032089 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-b56fc850-8ce1-44bb-990f-5a07244698cb req-2612bce0-330a-4d60-9fa9-3b277c7f5da4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035444 Aug 03 18:52:03.032815 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 136/270] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:52:03.262998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:03.263990 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:03.272944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:03.273409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:03.274428 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:03.274870 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:03.466102 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:03.470281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:03.478919 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-00d7d49f-ef91-410e-9262-5ac1eeb0c19d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.219341 Aug 03 18:52:03.479942 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 135/271] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:03 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:04.011192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:04.012025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:04.019135 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.019593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.020391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.020836 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.029862 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:04.031055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:04.034597 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] HTTP exception thrown: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.037545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.038000 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.038771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Request method failure captured: Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace HTTP/1.1 Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNxIXD6puH_gBn6i6HCj_94Cy9RPMQLiDiQbuZp9z0Mw7r08hRMvEuX0zqwNbd4kEGO0Y3UQSOYvjMrAwP58Zs4j6k5wDMbIJ8W2O0LdQ5iy9UcImXDy9jRUpdKlEuYkUU0dipgdO3ZVwWRZ6RrtiBPpP5DA3s6RAxKVv3ThJzSXn4 Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:52:04.039186 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a9ad699f792e4c50a898079291f09254"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a9ad699f792e4c50a898079291f09254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1f99fcc5eddd45c89abca70f00ad6fed Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.040753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '44a440b7-980a-4d76-9813-92f7ac63eace'} Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:52:04.042492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.043921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.046045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.046139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Returning 404 to user: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:52:04.046139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-44fddd7c-5ad4-4373-bc75-733138d5965a tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 404 len: 111 microversion: 2.1 time: 0.033742 Aug 03 18:52:04.046139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 137/272] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:04 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:52:04.159617 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:04.161772 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:04.167854 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.168338 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.169107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.170183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.177905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:04.182940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] HTTP exception thrown: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Request method failure captured: Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace/os-volume_attachments HTTP/1.1 Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNxIXD6puH_gBn6i6HCj_94Cy9RPMQLiDiQbuZp9z0Mw7r08hRMvEuX0zqwNbd4kEGO0Y3UQSOYvjMrAwP58Zs4j6k5wDMbIJ8W2O0LdQ5iy9UcImXDy9jRUpdKlEuYkUU0dipgdO3ZVwWRZ6RrtiBPpP5DA3s6RAxKVv3ThJzSXn4 Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:52:04.184585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a9ad699f792e4c50a898079291f09254"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a9ad699f792e4c50a898079291f09254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1f99fcc5eddd45c89abca70f00ad6fed Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.186755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'server_id': '44a440b7-980a-4d76-9813-92f7ac63eace'} Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:52:04.187559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:04.189476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:04.190818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Returning 404 to user: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:52:04.190907 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3027f03d-c6c0-43b3-8355-54b03ef4c587 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.160110 Aug 03 18:52:04.190993 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8b74769d-fcf6-4d50-8c17-844ac58592a7 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030943 Aug 03 18:52:04.190993 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 138/273] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 18:52:04 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 18:52:04.196883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 136/274] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:04 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:04.503252 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:04.504123 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:04.511122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.511571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.512356 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:04.512801 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:04.649238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:04.657024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e8a3d2d2-bf50-406a-8580-b2c4102fbd5f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.158817 Aug 03 18:52:04.657597 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 139/275] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:04 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:05.048656 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1153663290", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "networks": [{"uuid": "ca9dab83-c588-44a1-a0e0-66649ec04a71"}]}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:05.102238 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] validate_networks() for [('ca9dab83-c588-44a1-a0e0-66649ec04a71', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:52:05.207652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:05.208412 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:05.214556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.215005 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.215771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.216207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.439950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:05.447980 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6e4d24eb-f0d1-4f7d-adb9-7b3a9a5f24c4 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.244200 Aug 03 18:52:05.448710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 140/276] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:05 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:05.457245 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:05.458046 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:05.465603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.466290 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.468432 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.469203 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.491236 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] HTTP exception thrown: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Request method failure captured: Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace HTTP/1.1 Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNxIXD6puH_gBn6i6HCj_94Cy9RPMQLiDiQbuZp9z0Mw7r08hRMvEuX0zqwNbd4kEGO0Y3UQSOYvjMrAwP58Zs4j6k5wDMbIJ8W2O0LdQ5iy9UcImXDy9jRUpdKlEuYkUU0dipgdO3ZVwWRZ6RrtiBPpP5DA3s6RAxKVv3ThJzSXn4 Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:52:05.493422 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a9ad699f792e4c50a898079291f09254"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a9ad699f792e4c50a898079291f09254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1f99fcc5eddd45c89abca70f00ad6fed Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.495166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '44a440b7-980a-4d76-9813-92f7ac63eace'} Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:52:05.495985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.497390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.499286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Returning 404 to user: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:52:05.500896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9b9dc491-d036-42b1-9a95-f2223d3bd504 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "DELETE /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 404 len: 111 microversion: 2.1 time: 0.050143 Aug 03 18:52:05.501879 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 141/277] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:52:05 2022] DELETE /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:52:05.510653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:05.511551 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] [instance: 44a440b7-980a-4d76-9813-92f7ac63eace] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:05.532279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.532847 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.533738 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.534257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.548666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:52:05.549278 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:52:05.550038 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:52:05.550816 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:52:05.551359 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:52:05.556595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] HTTP exception thrown: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Request method failure captured: Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace HTTP/1.1 Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNxIXD6puH_gBn6i6HCj_94Cy9RPMQLiDiQbuZp9z0Mw7r08hRMvEuX0zqwNbd4kEGO0Y3UQSOYvjMrAwP58Zs4j6k5wDMbIJ8W2O0LdQ5iy9UcImXDy9jRUpdKlEuYkUU0dipgdO3ZVwWRZ6RrtiBPpP5DA3s6RAxKVv3ThJzSXn4 Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:52:05.558112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/a9ad699f792e4c50a898079291f09254"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_a9ad699f792e4c50a898079291f09254"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/a9ad699f792e4c50a898079291f09254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: a9ad699f792e4c50a898079291f09254 Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-DeleteServersTestJSON-774434938 Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1f99fcc5eddd45c89abca70f00ad6fed Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-DeleteServersTestJSON-774434938-project Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.559581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '44a440b7-980a-4d76-9813-92f7ac63eace'} Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:52:05.560995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. Aug 03 18:52:05.562340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:05.563984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.564192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] Returning 404 to user: Instance 44a440b7-980a-4d76-9813-92f7ac63eace could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:52:05.564605 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.565058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a0c2630d-888b-41c2-b7e4-380f72f55123 tempest-DeleteServersTestJSON-774434938 tempest-DeleteServersTestJSON-774434938-project] 10.222.0.69 "GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace" status: 404 len: 111 microversion: 2.1 time: 0.058752 Aug 03 18:52:05.565585 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.565729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 142/278] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:05 2022] GET /compute/v2.1/servers/44a440b7-980a-4d76-9813-92f7ac63eace => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:52:05.566343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.586160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Getting quotas for project 1fe2ae076eda4afa99c6c28464e1377b. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:52:05.590706 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Getting quotas for user 9201a1d107bf41959751e7d7c4e4d37d and project 1fe2ae076eda4afa99c6c28464e1377b. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:52:05.604843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:52:05.607677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:52:05.656394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-01542ff0-afb3-4143-b9ea-d1166f2a577e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611634 Aug 03 18:52:05.657046 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 137/279] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:52:05.668756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e83c9568-de5c-4b12-b3e8-bcb78d9f975e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:05.670636 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e83c9568-de5c-4b12-b3e8-bcb78d9f975e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:05.682163 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:05.682888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:05.697584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.698038 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.698958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:05.699402 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:05.757527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e83c9568-de5c-4b12-b3e8-bcb78d9f975e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:05.765921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e83c9568-de5c-4b12-b3e8-bcb78d9f975e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1214 microversion: 2.1 time: 0.101890 Aug 03 18:52:05.766514 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 143/280] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:05 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:05.938724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:05.947220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-aa3a9d56-39e3-4f3c-9324-2faf3d45cd7d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.269693 Aug 03 18:52:05.948028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 138/281] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:05 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:06.471309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:06.471950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:06.478484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:06.478984 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:06.479784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:06.480199 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:06.749494 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:06.758450 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0e9e6801-112d-422f-b107-3f0dc2fdfcc9 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1314 microversion: 2.1 time: 0.291229 Aug 03 18:52:06.759061 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 144/282] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:06 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:06.786345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:06.787623 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:06.797797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:06.798558 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:06.799851 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:06.800630 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:06.887842 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:06.896732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-153d54b2-f28a-4754-91a4-db777c9df123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1218 microversion: 2.1 time: 0.114249 Aug 03 18:52:06.901213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 139/283] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:06 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:06.970509 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:06.971384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:06.977255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:06.977708 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:06.978480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:06.979088 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:07.217611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:07.228800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d4bd3249-0ff9-4e94-b8e9-c6f4e682ea1e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.262902 Aug 03 18:52:07.229540 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 145/284] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:06 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:07.785439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:07.786486 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:07.797397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:07.798535 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:07.799657 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:07.800549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:07.932602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:07.933391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:07.944269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:07.944803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:07.945729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:07.946269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:08.051742 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:08.065141 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d6b6e212-4d49-477b-ab38-313d52f84532 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1272 microversion: 2.1 time: 0.145884 Aug 03 18:52:08.065727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 146/285] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:07 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:08.143059 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:08.160820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8a0958af-ab1a-40b3-8cd4-3725683500af tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1464 microversion: 2.1 time: 0.381247 Aug 03 18:52:08.162573 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 140/286] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:07 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1464 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:08.251160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:08.253609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:08.254523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:08.255338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:08.270084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:08.272969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:08.273780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:08.274221 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:08.278860 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:08.280024 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:08.281001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:08.281613 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:08.321744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:52:08.482475 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1a167d81-34f0-41f4-bb30-4d7b11784961 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 204 len: 0 microversion: 2.1 time: 0.238832 Aug 03 18:52:08.484032 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 147/287] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:52:08 2022] DELETE /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:52:08.494591 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:08.495566 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:08.504584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:08.505668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:08.506986 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:08.507607 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:08.744355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:08.759854 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7cc1365f-a3df-4c66-b4e5-7524374b2ab1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.512683 Aug 03 18:52:08.776921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 141/288] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:08 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:08.823552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:08.832093 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cc4b1c92-68ec-4afd-a30b-8a8ca467b64b tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1470 microversion: 2.1 time: 0.342478 Aug 03 18:52:08.833374 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 148/289] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:08 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:09.089966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:09.090647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:09.100120 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:09.100594 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:09.101415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:09.101861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:09.244058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:09.252410 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ddff4b1c-6f95-4573-b9f3-d10362a79c47 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.168975 Aug 03 18:52:09.253067 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 142/290] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:09 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:09.786740 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:09.788055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:09.794947 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:09.795667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:09.796919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:09.797620 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:09.857679 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:09.858478 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:09.864876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:09.865401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:09.866280 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:09.866828 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:10.221038 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:10.230943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-13eb5868-cc4e-4910-a6de-f3758ea6b201 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.445457 Aug 03 18:52:10.231545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 149/291] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:09 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:10.273890 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:10.274604 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:10.284530 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:10.285529 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:10.286363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:10.286812 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:10.302351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:10.313509 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-73970ae9-2b95-49ea-9ca9-65b2d68db695 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1470 microversion: 2.1 time: 0.461470 Aug 03 18:52:10.316874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 143/292] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:09 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1470 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:10.639040 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:10.653144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-57fff030-cd59-41f8-9515-9ba7eeebdd69 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.383077 Aug 03 18:52:10.654004 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 150/293] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:10 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:10.946583 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-0524328d-a4b3-4340-bbc6-6ae200f85ba3 req-ac163ec8-b045-4103-857f-515b28893f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b999fe04-fd6c-4b02-a28d-c0331cf740f9", "tag": "d1ea5b22-b2c3-4fd2-95c1-06d243986054"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:10.956670 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-0524328d-a4b3-4340-bbc6-6ae200f85ba3 req-ac163ec8-b045-4103-857f-515b28893f9f service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:10.957116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-0524328d-a4b3-4340-bbc6-6ae200f85ba3 req-ac163ec8-b045-4103-857f-515b28893f9f service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:10.969799 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-0524328d-a4b3-4340-bbc6-6ae200f85ba3 req-ac163ec8-b045-4103-857f-515b28893f9f service nova] Creating event network-changed:d1ea5b22-b2c3-4fd2-95c1-06d243986054 for instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 on hv-cinder-85164 Aug 03 18:52:10.975005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-0524328d-a4b3-4340-bbc6-6ae200f85ba3 req-ac163ec8-b045-4103-857f-515b28893f9f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034916 Aug 03 18:52:10.975915 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 144/294] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:52:11.257339 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:11.257968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:11.265568 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:11.266226 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:11.267012 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:11.267458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:11.338545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:11.339234 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:11.348167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:11.348638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:11.349401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:11.349833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:11.441064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:11.452631 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f2658adb-2ece-4d82-870b-a3370795dd0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.202016 Aug 03 18:52:11.453238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 151/295] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:11 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:11.536042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:11.546045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-babb86ad-f043-494a-a1ac-c3ccdd77bdd7 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1470 microversion: 2.1 time: 0.211895 Aug 03 18:52:11.546627 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 145/296] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:11 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:11.674038 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:11.674709 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:11.681927 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:11.682559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:11.683522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:11.684074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:11.966020 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:11.974856 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0f76fd6f-07b0-40fa-b0e4-71b01b9b4006 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.305526 Aug 03 18:52:11.975434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 152/297] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:11 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:12.476762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:12.477376 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:12.483972 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:12.484520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:12.485287 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:12.485730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:12.567483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:12.568145 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:12.574349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:12.574909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:12.575891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:12.577358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:12.882284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:12.889872 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6d572ef4-9a8d-452b-a14b-75d469634aa7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.416891 Aug 03 18:52:12.890543 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 146/298] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:12 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:12.902965 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:12.911019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fc997ae0-56e8-40ef-ae84-f465ee178744 tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1470 microversion: 2.1 time: 0.347362 Aug 03 18:52:12.911890 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 153/299] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:12 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1470 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:12.995726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:12.996411 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:13.003406 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:13.004225 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:13.005096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:13.005607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:13.236314 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:13.250500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-61c508b0-32ef-468c-bb53-a4a956217921 req-8d28b748-a2bc-4896-9cbe-382adf89d95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad786b70-63b3-4116-b230-d1dc7959adeb", "name": "network-vif-deleted", "tag": "eeb518e0-b830-4ed6-87dd-e9b16f11a9d1"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:13.256376 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9ce8eded-63ee-4a6f-b97b-c88e151ada31 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.264521 Aug 03 18:52:13.256975 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 147/300] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:12 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:13.262290 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-61c508b0-32ef-468c-bb53-a4a956217921 req-8d28b748-a2bc-4896-9cbe-382adf89d95c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:13.262961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-61c508b0-32ef-468c-bb53-a4a956217921 req-8d28b748-a2bc-4896-9cbe-382adf89d95c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:13.277016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-61c508b0-32ef-468c-bb53-a4a956217921 req-8d28b748-a2bc-4896-9cbe-382adf89d95c service nova] Creating event network-vif-deleted:eeb518e0-b830-4ed6-87dd-e9b16f11a9d1 for instance ad786b70-63b3-4116-b230-d1dc7959adeb on hv-cinder-85164 Aug 03 18:52:13.282729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-61c508b0-32ef-468c-bb53-a4a956217921 req-8d28b748-a2bc-4896-9cbe-382adf89d95c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037243 Aug 03 18:52:13.284175 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 154/301] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:52:13.914879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:13.916205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:13.923726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:13.924486 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:13.925474 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:13.926087 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:13.932710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:13.934022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:13.946683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:13.947147 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:13.947986 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:13.948442 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:14.047699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:14.055800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0cb7573c-d01a-418a-8d55-84551e82143d tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1428 microversion: 2.1 time: 0.127059 Aug 03 18:52:14.056710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 155/302] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:13 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:14.277289 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:14.277997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:14.285544 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:14.286298 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:14.287293 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:14.287797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:14.292909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:14.427712 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:14.435310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b50f2812-1441-4a9a-9b39-64a10e14834f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.526829 Aug 03 18:52:14.436442 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 148/303] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:13 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:14.472655 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:14.480084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2b094728-08f4-4e7e-be87-3b31e8ce1ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.206777 Aug 03 18:52:14.480672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 156/304] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:14 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:15.077328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:15.077986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:15.084423 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:15.086056 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:15.086056 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:15.086056 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:15.151235 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:15.159431 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fc2596d1-2963-4c01-a911-c65f8b0d9a2a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1428 microversion: 2.1 time: 0.086530 Aug 03 18:52:15.159984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 149/305] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:15 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:15.457753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:15.458393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:15.464376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:15.464825 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:15.465584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:15.466020 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:15.501533 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:15.502061 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:15.508462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:15.508918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:15.509693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:15.510128 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:15.575045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:15.599816 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:15.661731 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:15.669174 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6655cc01-306f-4ebc-8ba4-2a227a4a9fab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.215324 Aug 03 18:52:15.669746 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 157/306] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:15 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:15.689165 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:15.696644 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-de5d0d7b-e1c1-4228-9b2f-898226c19b22 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.199457 Aug 03 18:52:15.697210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 150/307] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:15 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:16.180716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:16.181570 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:16.183485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:16.191640 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:16.192167 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:16.193034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:16.193479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:16.226679 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:16.227132 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:16.227584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lazy-loading 'fault' on Instance uuid ad786b70-63b3-4116-b230-d1dc7959adeb {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:52:16.273696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:16.282117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fdd9f097-4e55-4190-bd12-cc16edcaed5a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1304 microversion: 2.1 time: 0.105504 Aug 03 18:52:16.282701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 158/308] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:16 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:16.690676 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:16.691192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:16.693492 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:16.698782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:16.699232 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:16.700009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:16.700452 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:16.719821 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:16.720708 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:16.726863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:16.727468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:16.728330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:16.728777 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:16.903712 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:16.917006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cafac222-b7de-4708-ad4e-b615186ab7db tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.225648 Aug 03 18:52:16.917006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 151/309] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:16 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:16.922908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:16.934147 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ac6bb64c-e0e1-42b5-87eb-3605ed35a1a5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.218911 Aug 03 18:52:16.938489 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 159/310] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:16 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:17.306293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:17.306827 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:17.313526 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:17.313657 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:17.314325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:17.314827 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:17.347174 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:17.347625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:17.348085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lazy-loading 'fault' on Instance uuid ad786b70-63b3-4116-b230-d1dc7959adeb {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:52:17.395682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f09070fbc0dc4486ae03bae2701fe85c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15b6902ce664c0ba8fc4cb0868fdaa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:17.403191 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d0bb6275-624a-4d8b-9e39-ce5467b6981a tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 200 len: 1304 microversion: 2.1 time: 0.101441 Aug 03 18:52:17.403881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 152/311] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:17 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:17.934009 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:17.934628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:17.944905 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:17.945575 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:17.946723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:17.947346 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:17.958425 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:17.959064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:17.971964 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:17.972454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:17.973242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:17.973679 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:17.996762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:18.233942 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:18.237331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:18.244652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-afed9e7f-1775-47c8-bc8a-d59280749d0b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.314216 Aug 03 18:52:18.245157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 160/312] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:17 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:18.253621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-514f83b9-cbc9-4f4f-b2be-3464522d57c8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.294141 Aug 03 18:52:18.253621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 153/313] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:17 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:18.425394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:18.425937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] [instance: ad786b70-63b3-4116-b230-d1dc7959adeb] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:18.432020 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:18.432521 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:18.433286 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:18.433725 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:18.447720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] HTTP exception thrown: Instance ad786b70-63b3-4116-b230-d1dc7959adeb could not be found. Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Request method failure captured: Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb HTTP/1.1 Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sOeDKerX11qTawodjdfMPDZMDePo71Nd3sXH2NxEZFGGTbXQ9SeFCWqZ8h1sHE2ZNgI-p9Tw40z4fRCktHcLmehHk9ChNW1kAngIl3tdq0VIlZTd2B2nDLhCDytxBigCGlR7ymerGOd1TstHy4gn3Xs_fnR2EK0ebBbFXOkmcQOWrA Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: f15b6902ce664c0ba8fc4cb0868fdaa3 Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesNegativeTest-1669571453 Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:52:18.452418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/f15b6902ce664c0ba8fc4cb0868fdaa3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f15b6902ce664c0ba8fc4cb0868fdaa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_f15b6902ce664c0ba8fc4cb0868fdaa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/f15b6902ce664c0ba8fc4cb0868fdaa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesNegativeTest-1669571453 Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: f15b6902ce664c0ba8fc4cb0868fdaa3 Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesNegativeTest-1669571453 Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesNegativeTest-1669571453-project Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: f09070fbc0dc4486ae03bae2701fe85c Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesNegativeTest-1669571453-project Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance ad786b70-63b3-4116-b230-d1dc7959adeb could not be found. Aug 03 18:52:18.453925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'ad786b70-63b3-4116-b230-d1dc7959adeb'} Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad786b70-63b3-4116-b230-d1dc7959adeb could not be found. Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:52:18.454702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad786b70-63b3-4116-b230-d1dc7959adeb could not be found. Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad786b70-63b3-4116-b230-d1dc7959adeb could not be found. Aug 03 18:52:18.456004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:18.457222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] Returning 404 to user: Instance ad786b70-63b3-4116-b230-d1dc7959adeb could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:52:18.457222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7d066404-d7e3-44e5-8d88-e2c9040242ab tempest-VolumesNegativeTest-1669571453 tempest-VolumesNegativeTest-1669571453-project] 10.222.0.69 "GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb" status: 404 len: 111 microversion: 2.1 time: 0.032580 Aug 03 18:52:18.457222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 154/314] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:18 2022] GET /compute/v2.1/servers/ad786b70-63b3-4116-b230-d1dc7959adeb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:52:19.266937 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:19.267553 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:19.273675 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:19.274120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:19.274228 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:19.274464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:19.274896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:19.275647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:19.288128 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:19.288603 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:19.289367 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:19.289797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:19.497453 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:19.500642 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:19.506977 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-29dc909c-6208-4d36-a910-dee191eb63a8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.244285 Aug 03 18:52:19.507571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 161/315] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:19 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:19.508661 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ee688bca-1647-4f40-a931-008fc68a3378 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.241627 Aug 03 18:52:19.509214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 155/316] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:19 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:20.531026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:20.532546 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:20.533018 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:20.534082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:20.539403 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:20.539957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:20.540180 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:20.540671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:20.540970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:20.541431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:20.541562 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:20.542125 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:20.749400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:20.750618 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:20.760379 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cd8e9ab4-c698-4a06-a46e-6d5c39761927 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.236551 Aug 03 18:52:20.760924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7a86bb58-cd21-45e5-a524-2e12fb937fa0 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.234640 Aug 03 18:52:20.761299 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 162/317] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:20 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:20.764541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 156/318] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:20 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:21.785348 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:21.785939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:21.786199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:21.786891 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:21.792773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:21.792773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:21.793541 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:21.793968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:21.794734 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:21.795180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:21.796178 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:21.796636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:21.986558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:21.993540 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:21.994488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-acc2b8fb-933e-462a-9859-bba0ed719624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.215545 Aug 03 18:52:21.995060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 163/319] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:21 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:22.002316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d5975d58-a4a1-4f19-ac12-dff97dd391ff tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.220623 Aug 03 18:52:22.002875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 157/320] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:21 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:23.017412 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:23.018042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:23.023376 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:23.024006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:23.024384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:23.024842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:23.025618 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:23.026060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:23.030798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:23.031378 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:23.032158 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:23.032619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:23.225310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:23.229588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:23.232924 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-162be112-77ef-484b-ab49-b867359859d2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.220330 Aug 03 18:52:23.234159 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 164/321] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:23 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:23.238062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-04311b0c-2aa1-47fc-ab75-89a94863079a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.218511 Aug 03 18:52:23.238616 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 158/322] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:23 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:24.255102 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:24.256369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:24.259347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:24.262265 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:24.264257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:24.264959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:24.265990 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:24.266609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:24.269791 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:24.270698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:24.271825 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:24.272264 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:24.485939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:24.494099 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-033bca8d-8448-46fd-80aa-e9b23266c615 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.243285 Aug 03 18:52:24.494299 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:24.494843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 165/323] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:24 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:24.503665 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-eda4a8c0-17da-4a86-b130-b074d42953ea tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.248190 Aug 03 18:52:24.504694 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 159/324] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:24 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:25.515610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:25.516229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:25.518100 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:25.523584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:25.524041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:25.524842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:25.524962 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:25.525392 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:25.525572 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:25.532649 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:25.533108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:25.533877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:25.534319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:25.739022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:25.743176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:25.747541 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b59bedd4-7926-42ee-a849-335914503978 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1520 microversion: 2.1 time: 0.235881 Aug 03 18:52:25.750950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 166/325] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:25 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:25.758616 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2883376f-b9f4-451c-9505-2c93ea0a98ef tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.237330 Aug 03 18:52:25.759288 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 160/326] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:25 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:26.771693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:26.772653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:26.779654 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:26.780504 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:26.780792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:26.781652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:26.782330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:26.782985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:26.790529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:26.790981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:26.791921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:26.792390 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:27.017884 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:27.026562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-dcebf49f-94ca-4503-9dd8-ada47a95c282 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1500 microversion: 2.1 time: 0.258294 Aug 03 18:52:27.027607 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 167/327] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:26 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1500 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:27.034252 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:27.043508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ff09f2d0-5074-49fd-a2ca-743c9666810c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.267903 Aug 03 18:52:27.044630 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 161/328] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:26 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:27.049969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:27.050870 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:27.060400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:27.061164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:27.062806 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:27.063843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:27.250136 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:27.259321 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c25b23ed-7f14-4b56-ae34-ae4491529267 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1515 microversion: 2.1 time: 0.213870 Aug 03 18:52:27.260024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 168/329] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:27 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:28.065614 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:28.066224 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:28.072818 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:28.073455 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:28.074228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:28.074668 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:28.245153 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:28.254032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b6949e0f-aa81-4bcf-9766-33244c4221d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.192637 Aug 03 18:52:28.255091 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 162/330] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:28 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:28.467006 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-a74fe68b-cfab-4334-90f5-df16b2e4b54f req-9275733a-afe9-47c3-a869-138043356c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b999fe04-fd6c-4b02-a28d-c0331cf740f9", "name": "network-vif-plugged", "status": "completed", "tag": "d1ea5b22-b2c3-4fd2-95c1-06d243986054"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:28.481377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-a74fe68b-cfab-4334-90f5-df16b2e4b54f req-9275733a-afe9-47c3-a869-138043356c66 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:28.482010 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-a74fe68b-cfab-4334-90f5-df16b2e4b54f req-9275733a-afe9-47c3-a869-138043356c66 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:28.497563 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-a74fe68b-cfab-4334-90f5-df16b2e4b54f req-9275733a-afe9-47c3-a869-138043356c66 service nova] Creating event network-vif-plugged:d1ea5b22-b2c3-4fd2-95c1-06d243986054 for instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 on hv-cinder-85164 Aug 03 18:52:28.506565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-a74fe68b-cfab-4334-90f5-df16b2e4b54f req-9275733a-afe9-47c3-a869-138043356c66 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044249 Aug 03 18:52:28.507761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 169/331] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:52:28.702018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:28.705239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:28.721977 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:28.722434 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:28.723220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:28.723659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:28.747341 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lazy-loading 'flavor' on Instance uuid eeaec340-ee41-4cc1-9812-e9840770a738 {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:52:28.860321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ae7f71ec-4c5f-43b7-8588-48a0b326679b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738/action" status: 200 len: 32 microversion: 2.1 time: 0.162827 Aug 03 18:52:28.860922 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 163/332] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:52:28 2022] POST /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 18:52:28.871039 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:28.871747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:28.879724 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:28.880182 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:28.880988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:28.881431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:29.019107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:29.026479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1bf680f7-168f-42db-a816-4dd67648c310 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.159637 Aug 03 18:52:29.027038 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 170/333] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:28 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:29.277563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:29.278268 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:29.286311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:29.286685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:29.287515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:29.287987 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:29.420792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:29.428866 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-241237ea-9583-42c6-870a-2c25924f6576 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.156184 Aug 03 18:52:29.429435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 164/334] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:29 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:29.688552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1780724038", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "networks": [{"uuid": "1ae3fbdf-65ac-4c67-b4ab-2cb923cbdc95"}]}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:29.745339 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] validate_networks() for [('1ae3fbdf-65ac-4c67-b4ab-2cb923cbdc95', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:52:30.047338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:30.048146 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:30.054104 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:30.054561 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:30.055319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:30.055781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:30.326041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:52:30.326467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:52:30.326940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:52:30.327358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:52:30.328961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:52:30.332129 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:30.338458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:30.338907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:30.339699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:30.340134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:30.340546 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-28f5d851-2649-431a-be7b-dc12a17b7c0c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.297428 Aug 03 18:52:30.347819 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 165/335] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:30 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:30.359780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Getting quotas for project 653198c47b6a4f68b5ac4932b02b95d0. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:52:30.363919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Getting quotas for user fe100dded4484be3981b33384f4c68b2 and project 653198c47b6a4f68b5ac4932b02b95d0. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:52:30.375244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:52:30.377619 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:52:30.442834 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cb72a9d2-aae6-431c-b59c-2437a98ff40b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758716 Aug 03 18:52:30.447204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 171/336] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:52:30.450080 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:30.450792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:30.459551 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-57708089-2cec-4a2d-b9dd-edde5b278b9f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:30.460964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-57708089-2cec-4a2d-b9dd-edde5b278b9f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:30.470574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:30.471673 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:30.472698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:30.473321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:30.526230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-57708089-2cec-4a2d-b9dd-edde5b278b9f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:30.537536 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-57708089-2cec-4a2d-b9dd-edde5b278b9f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1219 microversion: 2.1 time: 0.082409 Aug 03 18:52:30.538454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 172/337] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:30 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:30.634836 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:30.651934 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e422f498-c08d-48ff-b3b3-24824cbd3888 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1314 microversion: 2.1 time: 0.205581 Aug 03 18:52:30.652651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 166/338] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:30 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:31.361523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:31.362130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:31.368167 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:31.368648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:31.369405 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:31.369834 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:31.506295 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:31.514268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-79fac723-a602-4821-ad0c-60d187a85e24 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.157289 Aug 03 18:52:31.516015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 173/339] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:31 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:31.560710 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:31.561331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:31.569093 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:31.569538 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:31.570296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:31.570719 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:31.667508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:31.675151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f97c1538-0729-4eef-a4e9-6ccfa5d97d25 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1271 microversion: 2.1 time: 0.120032 Aug 03 18:52:31.688375 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 167/340] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:31 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:31.688672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:31.688672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:31.688672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:31.688672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:31.689130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:31.689130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:31.880017 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:31.883624 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:31.889180 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-23f022dd-7bdc-42f8-a6f2-420d7f7f7b2f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1498 microversion: 2.1 time: 0.216440 Aug 03 18:52:31.889771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 174/341] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:31 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1498 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:32.490676 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:32.491450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:32.507168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.507649 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.508501 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.508948 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.537726 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:32.538923 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:32.549263 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.549915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.551388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.551992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.567365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:52:32.585388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:32.679804 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-766a955e-334c-4dcd-bf53-deafea61e015 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 204 len: 0 microversion: 2.1 time: 0.195556 Aug 03 18:52:32.684228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 168/342] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:52:32 2022] DELETE /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:52:32.695885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:32.695885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:32.698510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.699253 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.699737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.700178 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.894806 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:32.902294 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-33e7f1ee-90ec-4e95-b8a0-4a98a8498e9f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.368387 Aug 03 18:52:32.902938 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 175/343] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:32 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:32.908042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:32.908769 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:32.914771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.915226 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.916261 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:32.916788 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:32.955136 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:32.963307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7af7aba9-898a-45c8-9758-a413a1b68d35 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1504 microversion: 2.1 time: 0.277705 Aug 03 18:52:32.964062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 169/344] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:32 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:32.998496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:33.007246 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0d854b0d-703d-4fa7-8279-a82abf80d119 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1277 microversion: 2.1 time: 0.103259 Aug 03 18:52:33.007810 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 176/345] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:32 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:33.925520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:33.939848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:33.950237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:33.950697 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:33.951480 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:33.951921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:33.986317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:33.987565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:33.994862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:34.002042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:34.002998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:34.003605 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:34.254372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:34.261920 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c7912843-37d2-4afa-bd5e-24dba8c882ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.342594 Aug 03 18:52:34.262494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 170/346] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:33 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:34.267787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:34.268462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:34.274177 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:34.274646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:34.275142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:34.275941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:34.276578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:34.287443 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-258313e9-ac62-4a44-ab44-b5d3f673d249 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1504 microversion: 2.1 time: 0.307132 Aug 03 18:52:34.288419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 177/347] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:33 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:34.535335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:34.542699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2369166e-d302-49b2-adee-7930f6a63c4f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.279257 Aug 03 18:52:34.543282 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 171/348] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:34 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:35.129360 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-6292f51f-365a-4a70-8455-5b450be704e1 req-3436b70f-2426-494d-8f96-360b93b23a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7524e55b-5314-4845-ba1e-2a0b21471f4f", "tag": "a3cd344b-efd7-47ed-94de-5b9a2dedc1ea"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:35.143327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-6292f51f-365a-4a70-8455-5b450be704e1 req-3436b70f-2426-494d-8f96-360b93b23a3f service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:35.144091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-6292f51f-365a-4a70-8455-5b450be704e1 req-3436b70f-2426-494d-8f96-360b93b23a3f service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:35.161555 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-6292f51f-365a-4a70-8455-5b450be704e1 req-3436b70f-2426-494d-8f96-360b93b23a3f service nova] Creating event network-changed:a3cd344b-efd7-47ed-94de-5b9a2dedc1ea for instance 7524e55b-5314-4845-ba1e-2a0b21471f4f on hv-cinder-85164 Aug 03 18:52:35.177381 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-6292f51f-365a-4a70-8455-5b450be704e1 req-3436b70f-2426-494d-8f96-360b93b23a3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054880 Aug 03 18:52:35.177976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 178/349] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:52:35.285096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:35.285668 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:35.292311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:35.292861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:35.293702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:35.294214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:35.310604 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:35.311458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:35.320484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:35.321222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:35.322261 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:35.322933 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:35.430444 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:35.439317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f8b80d0a-ed0b-4ab1-af44-67a3baed561d tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 200 len: 1462 microversion: 2.1 time: 0.132850 Aug 03 18:52:35.443402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 179/350] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:35 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 1462 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:35.526411 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:35.536803 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3898e724-693e-4833-a053-f6ad21126423 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.257448 Aug 03 18:52:35.538185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 172/351] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:35 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:35.563328 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:35.564335 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:35.570523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:35.570956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:35.571716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:35.572148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:35.744151 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:35.751608 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-886fc8bc-5aef-497e-962a-bd12b6cdde1e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.192616 Aug 03 18:52:35.752175 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 180/352] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:35 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:36.460165 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:36.460812 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: b999fe04-fd6c-4b02-a28d-c0331cf740f9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:36.467347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:36.467796 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:36.468668 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:36.469103 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:36.482026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] HTTP exception thrown: Instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 could not be found. Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Request method failure captured: Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 HTTP/1.1 Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sPMwXWg_FgrSCaYufwiNlyZYPGs2kQ-v3C8ZJY1PfCpd_oy1j-CXTRCNpKvc66gc58n_MaOaPK6LADtchS3wmyD-bOtjwYM40mQLMAU0uszOq0B4uh2cNez-JHWj3EZuTGhDLtjdQFtvAo0C_AmOedvVbhRIqUmuEy-YDU3ddAwpOM Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 1fe2ae076eda4afa99c6c28464e1377b Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesActionsTest-1690097821 Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:52:36.483677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesActionsTest-1690097821 Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 1fe2ae076eda4afa99c6c28464e1377b Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesActionsTest-1690097821 Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesActionsTest-1690097821-project Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 9201a1d107bf41959751e7d7c4e4d37d Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesActionsTest-1690097821-project Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 could not be found. Aug 03 18:52:36.485197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'b999fe04-fd6c-4b02-a28d-c0331cf740f9'} Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 could not be found. Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:52:36.485940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 could not be found. Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 could not be found. Aug 03 18:52:36.487340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:52:36.488684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Returning 404 to user: Instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:52:36.488684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dc25bb10-0600-4e95-b7ac-335c44a8a149 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9" status: 404 len: 111 microversion: 2.1 time: 0.028824 Aug 03 18:52:36.488684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 173/353] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:36 2022] GET /compute/v2.1/servers/b999fe04-fd6c-4b02-a28d-c0331cf740f9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:52:36.559552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:36.560416 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:36.567320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:36.567775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:36.568587 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:36.569022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:36.590286 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1905473539", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "networks": [{"uuid": "ca9dab83-c588-44a1-a0e0-66649ec04a71"}]}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:36.650152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] validate_networks() for [('ca9dab83-c588-44a1-a0e0-66649ec04a71', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:52:36.773891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:36.781893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8a0e1b4d-0c58-4402-a90d-01932c2ce638 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.226362 Aug 03 18:52:36.782468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 181/354] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:36 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:36.786925 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:36.787703 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:36.793612 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:36.794068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:36.794844 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:36.795284 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:37.013012 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:37.021450 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fae88203-4875-4fc6-b2da-2d4be07356fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.237983 Aug 03 18:52:37.022021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 182/355] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:36 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:37.112005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:52:37.112471 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:52:37.112951 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:52:37.113360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:52:37.113775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:52:37.122599 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:37.123050 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:37.123842 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:37.124838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:37.142771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Getting quotas for project 1fe2ae076eda4afa99c6c28464e1377b. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:52:37.146848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Getting quotas for user 9201a1d107bf41959751e7d7c4e4d37d and project 1fe2ae076eda4afa99c6c28464e1377b. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:52:37.157641 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:52:37.159843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:52:37.198079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-fe8189b5-d17c-4fb0-b2f0-c0f6b6048c33 req-fe42aa7c-dc25-4883-a9d2-2f9c25592727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b999fe04-fd6c-4b02-a28d-c0331cf740f9", "name": "network-vif-deleted", "tag": "d1ea5b22-b2c3-4fd2-95c1-06d243986054"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:37.205398 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-22c640b9-5a5f-4b86-8919-c5e9ec331b50 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619205 Aug 03 18:52:37.206213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 174/356] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 18:52:37.212749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-fe8189b5-d17c-4fb0-b2f0-c0f6b6048c33 req-fe42aa7c-dc25-4883-a9d2-2f9c25592727 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:37.213268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-fe8189b5-d17c-4fb0-b2f0-c0f6b6048c33 req-fe42aa7c-dc25-4883-a9d2-2f9c25592727 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:37.216886 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-046ddde9-cfd4-4da4-a24a-5ad6b79c30a3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:37.218097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-046ddde9-cfd4-4da4-a24a-5ad6b79c30a3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:37.227554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-fe8189b5-d17c-4fb0-b2f0-c0f6b6048c33 req-fe42aa7c-dc25-4883-a9d2-2f9c25592727 service nova] Creating event network-vif-deleted:d1ea5b22-b2c3-4fd2-95c1-06d243986054 for instance b999fe04-fd6c-4b02-a28d-c0331cf740f9 on hv-cinder-85164 Aug 03 18:52:37.232274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-fe8189b5-d17c-4fb0-b2f0-c0f6b6048c33 req-fe42aa7c-dc25-4883-a9d2-2f9c25592727 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037824 Aug 03 18:52:37.233120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 183/357] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:52:37.276622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-046ddde9-cfd4-4da4-a24a-5ad6b79c30a3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:37.284599 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-046ddde9-cfd4-4da4-a24a-5ad6b79c30a3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1214 microversion: 2.1 time: 0.071609 Aug 03 18:52:37.285163 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 175/358] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:37 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:37.803974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:37.804635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:37.810809 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:37.811259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:37.812253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:37.812728 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:37.941952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:37.949447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-57b29a12-d9b8-4dbe-ac6b-ee9b1ae66a34 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.149766 Aug 03 18:52:37.950011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 184/359] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:37 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:38.042984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:38.043593 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:38.050641 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:38.051088 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:38.051850 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:38.052319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:38.183552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:38.191131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-520b545b-4513-45aa-8d3f-a940087346cb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.151999 Aug 03 18:52:38.191698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 176/360] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:38 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:38.305695 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:38.306314 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:38.314712 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:38.315165 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:38.315938 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:38.316410 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:38.379672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:38.387104 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-84adba6a-d87d-4c06-9d3a-e11a6e55d84f tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1218 microversion: 2.1 time: 0.085345 Aug 03 18:52:38.387664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 185/361] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:38 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:38.971137 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:38.971905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:38.978249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:38.978704 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:38.979484 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:38.979959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:39.140095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:39.149500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9f19e9d0-0b5b-4482-8b76-797c9b12eb02 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.183051 Aug 03 18:52:39.150079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 177/362] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:38 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:39.213625 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:39.214843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:39.221846 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:39.222587 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:39.223657 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:39.224104 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:39.398664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:39.406821 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b3648c91-f759-4b60-bb99-0bafa3113779 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.197857 Aug 03 18:52:39.407395 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 186/363] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:39 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:39.408811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:39.409433 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:39.415502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:39.415952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:39.416757 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:39.417197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:39.486203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:39.493786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dc3ab335-aa91-4335-939a-6c13659668d3 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1266 microversion: 2.1 time: 0.089540 Aug 03 18:52:39.494354 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 178/364] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:39 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:40.171015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:40.172556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:40.178809 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:40.179266 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:40.180046 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:40.180519 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:40.318117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:40.325730 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0bd4eae7-58de-4683-95ac-993aebd9cd71 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.158627 Aug 03 18:52:40.326295 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 187/365] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:40 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:40.427105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:40.427716 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:40.433848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:40.434297 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:40.435059 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:40.435495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:40.515631 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:40.516731 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:40.518406 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:40.524017 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:40.524572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:40.525451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:40.525973 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:40.531705 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=8 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:40.579399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:40.587048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-547f5412-37d7-474f-a7a9-7643b1efdb91 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.163893 Aug 03 18:52:40.587659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 179/366] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:40 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:40.596784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:40.604306 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-deaabaab-b9ed-4959-85f3-54647da57aa5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.093166 Aug 03 18:52:40.604871 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 188/367] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:40 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:41.347116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:41.347732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:41.353779 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:41.354233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:41.354999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:41.355436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:41.486491 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:41.493881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7e9c6148-ab3f-4f74-90de-9197edf89df8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.150765 Aug 03 18:52:41.494435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 180/368] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:41 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:41.611942 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:41.612534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:41.618896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:41.619346 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:41.620223 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:41.620691 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:41.625294 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:41.626244 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:41.632991 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:41.633448 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:41.634284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:41.634702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:41.724037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:41.731427 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5302bb79-0b4c-487d-909b-41d11817e087 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.110206 Aug 03 18:52:41.731999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 181/369] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:41 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:41.783902 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:41.791486 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2bb8f27a-3840-4d60-ae83-1e8614bd78bd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.184684 Aug 03 18:52:41.792041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 189/370] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:41 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:42.518449 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:42.521264 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:42.529260 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:42.529730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:42.531014 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:42.531472 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:42.661815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:42.669117 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-234cca55-b3a6-4c98-b4d3-2a3b025852ed tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.157720 Aug 03 18:52:42.669678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 182/371] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:42 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:42.753579 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:42.754454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:42.760624 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:42.761073 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:42.761845 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:42.762279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:42.813249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:42.813781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:42.819848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:42.820313 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:42.821115 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:42.821555 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:42.829168 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:42.836459 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d04b50d4-59ed-48e8-a03e-4a14acb242b9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.088009 Aug 03 18:52:42.837228 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 190/372] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:42 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:42.952140 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:42.959705 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2d895834-5b90-4f47-bb93-4d504c312407 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.151173 Aug 03 18:52:42.960267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 183/373] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:42 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:43.691827 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:43.692398 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:43.698513 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:43.698963 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:43.699721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:43.700159 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:43.832829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:43.840358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-104a6752-4c8b-4be9-a242-1532b6f9a84b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.152672 Aug 03 18:52:43.840922 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 191/374] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:43 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:43.857838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:43.858477 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:43.865038 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:43.865502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:43.866248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:43.866684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:43.934018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:43.942638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-275f1e0d-e7ac-4c0b-a256-f564ebaffec4 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.088596 Aug 03 18:52:43.943142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 184/375] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:43 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:43.980173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:43.980811 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:43.987182 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:43.987632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:43.988421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:43.988858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:44.121501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:44.125735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:44.131050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1619e6bd-4b0d-4193-b192-db52280a7f8d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.154685 Aug 03 18:52:44.131613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 192/376] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:43 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:44.861767 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:44.862383 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:44.868926 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:44.869380 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:44.870148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:44.870588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:44.963358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:44.963980 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:44.970797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:44.971247 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:44.972030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:44.972516 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:45.002044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:45.009821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3dc3d5c2-c60e-4bd5-ae9e-e8d628c7bda5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.152172 Aug 03 18:52:45.010384 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 185/377] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:44 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:45.037010 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:45.044405 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-62739993-68ee-4e97-b9a5-07168a5ae9a2 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.084879 Aug 03 18:52:45.045135 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 193/378] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:44 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:45.151261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:45.151863 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:45.158003 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:45.158440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:45.159193 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:45.159624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:45.163625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:45.292205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:45.300447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2a895f0b-8d3e-4ed2-82e1-7aa55cb9c99c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.152901 Aug 03 18:52:45.301014 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 186/379] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:45 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:46.033480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:46.034089 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:46.040083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:46.040561 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:46.041314 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:46.041747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:46.065100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:46.065737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:46.072265 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:46.072752 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:46.073524 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:46.073967 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:46.144119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:46.151701 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e35ef8be-9c4b-460d-ac06-07d50d56a344 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.090470 Aug 03 18:52:46.152474 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 187/380] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:46 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:46.211286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:46.219409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-34c607e1-64bb-4541-a905-40b38babd6a4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.190432 Aug 03 18:52:46.219933 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 194/381] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:46 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:46.322952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:46.323566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:46.330714 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:46.331817 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:46.332619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:46.333056 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:46.463871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:46.472097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5de376a7-f12f-4032-b36b-b14e3af7bb12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.153024 Aug 03 18:52:46.472700 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 188/382] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:46 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:47.177256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:47.177927 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:47.184023 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:47.184505 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:47.185310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:47.185689 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:47.240645 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:47.241250 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:47.243521 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:47.244186 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:47.248685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:47.250800 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:47.251251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:47.252074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:47.252636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:47.256550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d008cfeb-cfac-4023-b9bd-d7f748e469fa tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.083061 Aug 03 18:52:47.257958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 195/383] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:47 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:47.286247 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=8 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:47.391325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:47.399462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a7f37412-036b-4008-b550-9169fdfeeedb tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.162862 Aug 03 18:52:47.400028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 189/384] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:47 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:47.493044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:47.493657 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:47.500489 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:47.500963 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:47.501725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:47.502163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:47.642478 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:47.649796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4608ab09-d1cd-4cf9-9155-def1ea834873 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.160606 Aug 03 18:52:47.650359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 196/385] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:47 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:48.278123 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:48.278760 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:48.285482 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:48.285950 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:48.286705 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:48.287142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:48.352826 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:48.360994 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5d420483-4a16-45ec-a68c-5d608417cde5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1274 microversion: 2.1 time: 0.087461 Aug 03 18:52:48.361580 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 190/386] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:48 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:48.420440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:48.421232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:48.427294 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:48.427750 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:48.428556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:48.428999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:48.577164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:48.584858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-383e7f63-f4be-4c4f-9643-6bc281506e0a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.168334 Aug 03 18:52:48.585465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 197/387] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:48 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:48.670618 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:48.671833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:48.677689 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:48.678138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:48.678903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:48.679336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:48.812823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:48.820101 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-101c3606-dd8f-456f-98c1-8638b527465b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.153346 Aug 03 18:52:48.820708 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 191/388] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:48 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:49.381837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:49.382452 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:49.388558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:49.388957 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:49.390415 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:49.390900 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:49.482320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:49.491359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-71e4da15-a893-42e4-a7d3-4d5eb9d2247a tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1272 microversion: 2.1 time: 0.113575 Aug 03 18:52:49.492056 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 198/389] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:49 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:49.608534 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:49.609761 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:49.616972 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:49.617418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:49.618200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:49.618634 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:49.841538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:49.842148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:49.851079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:49.851721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:49.852180 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:49.853054 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:49.856127 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:49.861502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e95de433-81b8-4936-b155-13496bd80497 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.257086 Aug 03 18:52:49.862483 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 192/390] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:49 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:50.067559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:50.075080 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-46ba2ce2-c7b8-4294-bfb8-af1d1e0323ea tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.237553 Aug 03 18:52:50.075652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 199/391] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:49 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:50.513308 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:50.513925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:50.520023 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:50.520514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:50.521287 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:50.521730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:50.729214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:50.738745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b8cda5f2-4d62-444b-968a-22317eab1a8e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.229382 Aug 03 18:52:50.739532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 193/392] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:50 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:50.748154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-b2e7102c-64ce-4376-959f-9fc3f222d934 req-98d83e51-3bdb-4a42-ab89-0d0429cc6c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7524e55b-5314-4845-ba1e-2a0b21471f4f", "name": "network-vif-plugged", "status": "completed", "tag": "a3cd344b-efd7-47ed-94de-5b9a2dedc1ea"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:50.759473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-b2e7102c-64ce-4376-959f-9fc3f222d934 req-98d83e51-3bdb-4a42-ab89-0d0429cc6c82 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:50.760066 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-b2e7102c-64ce-4376-959f-9fc3f222d934 req-98d83e51-3bdb-4a42-ab89-0d0429cc6c82 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:50.773917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-b2e7102c-64ce-4376-959f-9fc3f222d934 req-98d83e51-3bdb-4a42-ab89-0d0429cc6c82 service nova] Creating event network-vif-plugged:a3cd344b-efd7-47ed-94de-5b9a2dedc1ea for instance 7524e55b-5314-4845-ba1e-2a0b21471f4f on hv-cinder-85164 Aug 03 18:52:50.779322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-b2e7102c-64ce-4376-959f-9fc3f222d934 req-98d83e51-3bdb-4a42-ab89-0d0429cc6c82 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036084 Aug 03 18:52:50.780000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 200/393] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:52:50.885942 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:50.886591 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:50.893381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:50.893845 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:50.894676 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:50.895106 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:51.096168 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:51.097136 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:51.103343 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:51.103792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:51.104585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:51.105023 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:51.123085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:51.131864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6c50ffaf-c564-457e-b513-ef7b9b9b7efc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.249705 Aug 03 18:52:51.132603 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 194/394] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:50 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:51.354482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:51.363824 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f4cf334a-6f62-4ce3-b53b-7d94a99bc7d8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.272303 Aug 03 18:52:51.376573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 201/395] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:51 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:51.416179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-9f8f8831-ee2e-4fcc-b6d0-677957e2339c req-90160f5b-4303-4c67-a5c3-4970d05658eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3c1240-94bc-4682-b211-6b628d2e63ff", "tag": "a110d3d2-e38d-4ce8-8ee0-321e46f7c098"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:51.426485 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9f8f8831-ee2e-4fcc-b6d0-677957e2339c req-90160f5b-4303-4c67-a5c3-4970d05658eb service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:51.427012 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9f8f8831-ee2e-4fcc-b6d0-677957e2339c req-90160f5b-4303-4c67-a5c3-4970d05658eb service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:51.439894 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-9f8f8831-ee2e-4fcc-b6d0-677957e2339c req-90160f5b-4303-4c67-a5c3-4970d05658eb service nova] Creating event network-changed:a110d3d2-e38d-4ce8-8ee0-321e46f7c098 for instance 4b3c1240-94bc-4682-b211-6b628d2e63ff on hv-cinder-85164 Aug 03 18:52:51.445023 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-9f8f8831-ee2e-4fcc-b6d0-677957e2339c req-90160f5b-4303-4c67-a5c3-4970d05658eb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032704 Aug 03 18:52:51.445730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 195/396] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:52:51.760455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:51.761176 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:51.767433 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:51.767910 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:51.768799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:51.769409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:51.907720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:51.915381 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-74c81a9b-f1f1-4c40-bde9-531fb0b6c9cd tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.158828 Aug 03 18:52:51.915955 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 202/397] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:51 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:52.154132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:52.154837 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:52.161743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.162190 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.162952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.163392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.349339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:52.357110 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0112780a-5fa7-486e-96c1-e3b85ee7e35e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1501 microversion: 2.1 time: 0.207660 Aug 03 18:52:52.357758 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 196/398] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:52 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1501 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:52.380380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faff4d66-128e-4842-b8a6-f997c1b65ea0"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:52.383435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:52.390178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.390878 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.391838 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.392385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.398002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:52.399432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:52.407987 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.408594 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.409616 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.410124 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.424862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] HTTP exception thrown: Cannot 'attach_volume' instance eeaec340-ee41-4cc1-9812-e9840770a738 while it is in vm_state rescued Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Request method failure captured: Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: POST /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738/os-volume_attachments HTTP/1.1 Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 74 Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNvll95s2JABXcKEHVk4FbLHf6AY01rjPFZb7Nx52UR3RxU4xxPzYx0vbmghA_JCPLuql4FzknWrFab_fMCoDQDUGDtTlqhU86sCalI4Gc9fkhX8_AyMiJER3bu2xysUFlZkf2p1YAAXNMbA5rgUo0ARE4ZuPEOzCnvsmmUzx2UILk Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:52:52.426729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: c6085ba9dff1480a8a1674e492e0c6c3 Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {"volumeAttachment": {"volumeId": "faff4d66-128e-4842-b8a6-f997c1b65ea0"}} Aug 03 18:52:52.428260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Cannot 'attach_volume' instance eeaec340-ee41-4cc1-9812-e9840770a738 while it is in vm_state rescued Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'server_id': 'eeaec340-ee41-4cc1-9812-e9840770a738', 'body': {'volumeAttachment': {'volumeId': 'faff4d66-128e-4842-b8a6-f997c1b65ea0'}}} Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eeaec340-ee41-4cc1-9812-e9840770a738 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:52:52.429166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance eeaec340-ee41-4cc1-9812-e9840770a738 while it is in vm_state rescued Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:52:52.430462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:52:52.431725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:52:52.431725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:52:52.431725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance eeaec340-ee41-4cc1-9812-e9840770a738 while it is in vm_state rescued Aug 03 18:52:52.431725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:52:52.431725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Returning 409 to user: Cannot 'attach_volume' instance eeaec340-ee41-4cc1-9812-e9840770a738 while it is in vm_state rescued {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:52:52.431725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-62bf46ad-cee0-4e1a-bd1f-dabc26178943 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055736 Aug 03 18:52:52.431725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 203/399] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 18:52:52 2022] POST /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 18:52:52.444852 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8e543203-4b3c-4174-bd4b-d664fdd96a3f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:52:52.445428 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8e543203-4b3c-4174-bd4b-d664fdd96a3f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:52.452362 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e543203-4b3c-4174-bd4b-d664fdd96a3f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.452816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e543203-4b3c-4174-bd4b-d664fdd96a3f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.454187 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e543203-4b3c-4174-bd4b-d664fdd96a3f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.454669 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e543203-4b3c-4174-bd4b-d664fdd96a3f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.524345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8e543203-4b3c-4174-bd4b-d664fdd96a3f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738/action" status: 202 len: 0 microversion: 2.1 time: 0.083396 Aug 03 18:52:52.525294 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 204/400] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:52:52 2022] POST /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:52:52.533879 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:52.534714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:52.541758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.542228 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.543011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.543451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.560611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:52.569638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-94048765-54b8-44d8-bdce-5f12fc975b13 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.180591 Aug 03 18:52:52.570330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 197/401] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:52 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:52.683516 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:52.691488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b80f2b19-9331-4b59-bfda-4b0016d27225 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.162091 Aug 03 18:52:52.692045 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 205/402] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:52 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:52.937329 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:52.938001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:52.944210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.944703 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:52.945466 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:52.945901 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:53.076115 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:53.085874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cb166a0f-f372-4d41-9ce8-e97eec4e0bd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.152473 Aug 03 18:52:53.086441 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 198/403] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:52 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:53.592025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:53.592847 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:53.602338 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:53.602857 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:53.603632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:53.604722 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:53.716685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:53.717290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:53.724475 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:53.725331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:53.726094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:53.726522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:53.739572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:53.747096 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a92b7df2-6b04-473f-8e29-3520186f4f2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.159002 Aug 03 18:52:53.747664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 206/404] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:53 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:53.857046 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:53.865143 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c329f515-6521-4bcc-95a5-903f56a917a0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.152254 Aug 03 18:52:53.865706 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 199/405] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:53 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:54.106867 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:54.107517 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:54.114119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:54.114561 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:54.115312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:54.115746 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:54.244740 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:54.252001 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-94f3db49-7295-4091-9c36-badf7862aa29 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.149122 Aug 03 18:52:54.252599 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 207/406] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:54 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:54.768929 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:54.769796 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:54.776510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:54.776970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:54.777736 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:54.778239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:54.890552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:54.896385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:54.896385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:54.899232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:54.899748 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:54.900615 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:54.901151 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:54.910116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:54.917840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e57e0360-eaf8-4f8a-a8ec-a36eec3fec2a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.153693 Aug 03 18:52:54.918409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 200/407] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:54 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:55.034659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:55.042099 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-113546b2-f658-4527-ab51-30a90ca288bc tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.156117 Aug 03 18:52:55.042668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 208/408] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:54 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:55.272691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:55.273300 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:55.279301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:55.279751 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:55.280583 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:55.281050 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:55.415415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:55.423453 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-154c13be-e635-4e71-8eb3-352a1e8e66b8 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.154599 Aug 03 18:52:55.424024 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 201/409] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:55 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:55.940124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:55.940914 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:55.949822 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:55.950420 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:55.951492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:55.952135 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:55.978577 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:56.063911 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:56.064618 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:56.071181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:56.071637 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:56.072441 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:56.072888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:56.092678 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:56.100388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fadb9aa2-31ce-4947-b073-e904cb9193be tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.165062 Aug 03 18:52:56.100959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 209/410] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:55 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:56.206435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:56.213913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-543266a2-d032-49c6-861c-dc2378982695 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.154861 Aug 03 18:52:56.214480 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 202/411] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:56 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:56.444008 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:56.444588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:56.450547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:56.451000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:56.451764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:56.452209 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:56.581945 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:56.589576 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9457dcfb-1d11-4649-a2af-92d21ff363e9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.149658 Aug 03 18:52:56.590144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 210/412] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:56 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:57.121673 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:57.122289 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:57.129703 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:57.130161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:57.130934 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:57.131371 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:57.149958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:52:57.234700 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:57.235549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:57.241516 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:57.241970 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:57.242742 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:57.243533 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:57.264487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:57.273307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e36577b6-4c7e-4110-806f-8fc8ffb068f5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.155482 Aug 03 18:52:57.274168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 203/413] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:57 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:57.372238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:57.380720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6cc056ee-093e-439a-a908-028786bf2002 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.149851 Aug 03 18:52:57.381282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 211/414] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:57 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:57.611440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:57.612046 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:57.618124 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:57.618572 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:57.619330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:57.619819 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:57.747209 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:57.755509 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f0c7718b-e7a0-4401-b42f-7a04f0fce5d5 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.148644 Aug 03 18:52:57.756094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 204/415] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:57 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:58.295202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:58.295818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:58.302377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:58.302831 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:58.303599 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:58.304037 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:58.402759 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:58.403380 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:58.410506 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:58.410963 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:58.411743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:58.412184 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:58.439149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:58.446765 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b551ca51-a6b0-4ad4-9e27-4a00080bbbad tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.155608 Aug 03 18:52:58.447341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 212/416] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:58 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:58.543221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:58.551505 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-72898e41-d4c6-4db9-a6f8-7043d7d53952 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.152585 Aug 03 18:52:58.552012 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 205/417] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:58 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:58.776733 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:58.777359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:58.784282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:58.784757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:58.785525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:58.785964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:58.919266 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:58.927301 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e0f86ea7-aa30-41fa-8f3f-ba05c9cbf12e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.154651 Aug 03 18:52:58.927863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 213/418] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:58 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:59.467198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:59.467846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:59.475493 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:59.475946 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:59.476949 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:59.477397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:59.573866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:59.574496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:59.581734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:59.582185 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:59.582979 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:59.583419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:59.611042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:59.618549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cdb78017-4371-4742-aeb5-6bb076be75d3 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1319 microversion: 2.1 time: 0.155186 Aug 03 18:52:59.619129 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 206/419] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:59 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:52:59.711513 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:52:59.719094 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-84518fed-13d6-40e5-9b91-fb47847498dd tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.149002 Aug 03 18:52:59.719660 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 214/420] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:59 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:52:59.946930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:52:59.947548 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:52:59.953880 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:59.954095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:52:59.954852 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:52:59.955284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:00.346110 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:00.353680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2d21fe2c-c0ee-4fd9-b8d6-1124fc83d10e tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.410539 Aug 03 18:53:00.354256 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 207/421] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:52:59 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:00.641039 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:00.642146 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:00.648693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:00.649149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:00.649928 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:00.650368 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:00.740743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:00.741465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:00.748188 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:00.748662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:00.749502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:00.749936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:00.790443 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:00.798006 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b7c128c9-2ee3-4bec-a353-c97df5350fc7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1508 microversion: 2.1 time: 0.160973 Aug 03 18:53:00.798592 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 215/422] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:00 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:00.890096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:00.899347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-01fdee50-1389-4dcf-8a89-7c35d8da9056 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.162383 Aug 03 18:53:00.900105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 208/423] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:00 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:53:01.377309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:01.378272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:01.387513 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:01.388279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:01.389087 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:01.390282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:01.608585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:01.617236 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e30faccb-8a84-49f1-82cf-09d9f0acffd6 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.245266 Aug 03 18:53:01.617950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 216/424] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:01 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:01.921639 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:01.922239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:01.930436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:01.932183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:01.932183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:01.932422 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:02.073005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:02.081221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1e9f267b-fa34-4ea6-8fc7-f3edb5c801ac tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.163916 Aug 03 18:53:02.081797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 209/425] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:01 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:02.489882 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-bd493191-493b-426c-8790-f23bb0ed6725 req-17cf8fbc-59a2-4980-9a4f-94c5d81d0af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3c1240-94bc-4682-b211-6b628d2e63ff", "name": "network-vif-plugged", "status": "completed", "tag": "a110d3d2-e38d-4ce8-8ee0-321e46f7c098"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:02.499895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-bd493191-493b-426c-8790-f23bb0ed6725 req-17cf8fbc-59a2-4980-9a4f-94c5d81d0af6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:02.500423 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-bd493191-493b-426c-8790-f23bb0ed6725 req-17cf8fbc-59a2-4980-9a4f-94c5d81d0af6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:02.514244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-bd493191-493b-426c-8790-f23bb0ed6725 req-17cf8fbc-59a2-4980-9a4f-94c5d81d0af6 service nova] Creating event network-vif-plugged:a110d3d2-e38d-4ce8-8ee0-321e46f7c098 for instance 4b3c1240-94bc-4682-b211-6b628d2e63ff on hv-cinder-85164 Aug 03 18:53:02.520644 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-bd493191-493b-426c-8790-f23bb0ed6725 req-17cf8fbc-59a2-4980-9a4f-94c5d81d0af6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035685 Aug 03 18:53:02.521255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 217/426] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:02.640002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:02.640646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:02.647405 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:02.648140 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:02.649131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:02.649574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:02.791206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:02.799701 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-65083fab-f607-4576-9712-8d68a5a359de tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.164593 Aug 03 18:53:02.800296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 210/427] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:02 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:03.103593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:03.104231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:03.112074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:03.112553 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:03.113327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:03.113770 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:03.253361 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:03.261056 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ba513f65-8ad3-41fe-8e9f-b0ea4d692a79 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.162379 Aug 03 18:53:03.261770 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 218/428] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:03 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:03.821237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:03.821893 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:03.828595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:03.829752 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:03.830583 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:03.831082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:03.974758 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:03.982206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-244e7a93-4749-45f8-8cd5-416d5bd24ba9 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.164875 Aug 03 18:53:03.982762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 211/429] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:03 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:04.283864 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:04.284513 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:04.291435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:04.292339 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:04.293390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:04.293829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:04.453206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:04.465404 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1520f749-2f81-4118-a001-89b2f5a4d40a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1509 microversion: 2.1 time: 0.185142 Aug 03 18:53:04.477989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 219/430] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:04 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:05.003461 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:05.004344 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:05.010922 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:05.011371 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:05.012138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:05.012669 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:05.175137 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:05.182790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c3043f90-603d-416d-8260-dbd10bab25ce tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.183665 Aug 03 18:53:05.183397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 212/431] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:04 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:05.495531 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:05.496158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:05.503077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:05.503785 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:05.504592 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:05.505633 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:05.653091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:05.661756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b9ac728f-7f11-47d2-8086-80428a6e6454 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1515 microversion: 2.1 time: 0.169876 Aug 03 18:53:05.662961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 220/432] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:05 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:06.204235 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:06.204889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:06.211559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:06.212008 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:06.213222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:06.213657 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:06.353544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:06.361857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2c74ccbf-b151-4eb4-b5d6-8d1c1966b987 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1314 microversion: 2.1 time: 0.161477 Aug 03 18:53:06.362626 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 213/433] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:06 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:07.053913 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a7478616-f6c4-4d79-a5ae-3be597747a93 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'create', calling method: .version_select at 0x7fdaca1d7040>, body: {"keypair": {"name": "tempest-keypair-64207063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPearBZ9gAAaJo3oyHAQZ6Usm/lIBBQbNF9R3C3RFRM/OlNGdG7gE7PjPuGaxCuscWPPQQ2y6Qpma+CPp3zJWO958GoHYqAJBG7yDqT1UoXkD+oJsp/kdvQvT3zhR30t9g=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:07.070091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-a7478616-f6c4-4d79-a5ae-3be597747a93 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:53:07.074624 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-a7478616-f6c4-4d79-a5ae-3be597747a93 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for user c6085ba9dff1480a8a1674e492e0c6c3 and project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:53:07.100203 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a7478616-f6c4-4d79-a5ae-3be597747a93 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050064 Aug 03 18:53:07.100954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 221/434] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 18:53:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:07.384002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:07.385210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:07.394880 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:07.395792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:07.400704 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:07.401413 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:07.602089 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:07.613766 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-92f11709-ce9c-44db-b090-d01794e81123 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1499 microversion: 2.1 time: 0.234154 Aug 03 18:53:07.620572 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 214/435] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:07 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1499 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:08.288802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:08.289546 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:08.296028 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:08.296694 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:08.297551 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:08.298061 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:08.324899 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:53:08.406211 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c778c826-c58a-41ce-967d-e93dac105c30 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 204 len: 0 microversion: 2.1 time: 0.120834 Aug 03 18:53:08.407131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 222/436] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:53:08 2022] DELETE /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:53:08.416178 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:08.417009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:08.424229 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:08.424723 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:08.425500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:08.425943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:08.661932 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:08.670628 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-eebcf469-d4c7-47c9-8a83-39d68552e79c tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1505 microversion: 2.1 time: 0.258264 Aug 03 18:53:08.671263 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 215/437] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:08 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:08.767837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1612265783", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d18d75c6-7a07-4f4e-8d93-dcdb199c0a5f"}], "security_groups": [{"name": "tempest-securitygroup--549142697"}], "key_name": "tempest-keypair-64207063", "user_data": "}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:08.880040 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] validate_networks() for [('d18d75c6-7a07-4f4e-8d93-dcdb199c0a5f', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:53:09.269412 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:53:09.270472 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:53:09.270989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:53:09.271414 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:53:09.271839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:53:09.280869 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:09.281322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:09.282134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:09.283198 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:09.300413 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:53:09.304429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Getting quotas for user c6085ba9dff1480a8a1674e492e0c6c3 and project 81ddb9c7b0f442df80831cc49287fd57. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:53:09.316430 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:53:09.318723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:53:09.365921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-77f4bd88-4a55-495d-b592-11d66c4fdba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.602779 Aug 03 18:53:09.366738 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 223/438] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:53:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:53:09.378822 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-71119c31-7ab4-47fc-bd21-db2a5d4fb434 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:09.379784 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-71119c31-7ab4-47fc-bd21-db2a5d4fb434 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:09.439090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-71119c31-7ab4-47fc-bd21-db2a5d4fb434 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:09.447007 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-71119c31-7ab4-47fc-bd21-db2a5d4fb434 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1244 microversion: 2.1 time: 0.072025 Aug 03 18:53:09.447849 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 216/439] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:09 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1244 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:09.693595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:09.694485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:09.700699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:09.701156 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:09.702030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:09.702383 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:09.858780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:09.866431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9bd978cc-c122-4a0b-8ccd-487888895f41 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1505 microversion: 2.1 time: 0.177560 Aug 03 18:53:09.867025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 224/440] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:09 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:10.468160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:10.468819 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:10.477782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:10.478267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:10.479142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:10.479609 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:10.553702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:10.561531 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a99f3719-8af7-46a2-95f5-4fafad95fd20 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1296 microversion: 2.1 time: 0.097230 Aug 03 18:53:10.562250 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 217/441] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:10 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:10.888668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:10.889299 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:10.896666 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:10.897160 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:10.898009 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:10.898534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:11.133942 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9201a1d107bf41959751e7d7c4e4d37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fe2ae076eda4afa99c6c28464e1377b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:11.149248 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5acb3a72-e48d-4c57-97b3-62f1366b7d33 tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 200 len: 1505 microversion: 2.1 time: 0.260509 Aug 03 18:53:11.165012 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 225/442] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:10 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:53:11.424756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-3b5d08bb-8add-4d2e-9f51-b60f2c5d043e req-d842e346-35c5-4c55-bd20-55219ec8ff30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3c1240-94bc-4682-b211-6b628d2e63ff", "name": "network-vif-deleted", "tag": "a110d3d2-e38d-4ce8-8ee0-321e46f7c098"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:11.434498 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-3b5d08bb-8add-4d2e-9f51-b60f2c5d043e req-d842e346-35c5-4c55-bd20-55219ec8ff30 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:11.434944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-3b5d08bb-8add-4d2e-9f51-b60f2c5d043e req-d842e346-35c5-4c55-bd20-55219ec8ff30 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:11.451564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-3b5d08bb-8add-4d2e-9f51-b60f2c5d043e req-d842e346-35c5-4c55-bd20-55219ec8ff30 service nova] Creating event network-vif-deleted:a110d3d2-e38d-4ce8-8ee0-321e46f7c098 for instance 4b3c1240-94bc-4682-b211-6b628d2e63ff on hv-cinder-85164 Aug 03 18:53:11.457888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-3b5d08bb-8add-4d2e-9f51-b60f2c5d043e req-d842e346-35c5-4c55-bd20-55219ec8ff30 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036884 Aug 03 18:53:11.458496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 218/443] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:11.585324 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:11.586351 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:11.595253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:11.596116 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:11.597145 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:11.597859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:11.671192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:11.677045 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:11.682445 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-af57be25-1f20-456f-8a0c-dfaceb3d4de4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1302 microversion: 2.1 time: 0.103224 Aug 03 18:53:11.683221 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 226/444] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:11 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:12.172585 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:12.173566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] [instance: 4b3c1240-94bc-4682-b211-6b628d2e63ff] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:12.200553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:12.201301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:12.202295 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:12.203188 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:12.237545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] HTTP exception thrown: Instance 4b3c1240-94bc-4682-b211-6b628d2e63ff could not be found. Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Request method failure captured: Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff HTTP/1.1 Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sPMwXWg_FgrSCaYufwiNlyZYPGs2kQ-v3C8ZJY1PfCpd_oy1j-CXTRCNpKvc66gc58n_MaOaPK6LADtchS3wmyD-bOtjwYM40mQLMAU0uszOq0B4uh2cNez-JHWj3EZuTGhDLtjdQFtvAo0C_AmOedvVbhRIqUmuEy-YDU3ddAwpOM Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 1fe2ae076eda4afa99c6c28464e1377b Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesActionsTest-1690097821 Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:53:12.241223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1fe2ae076eda4afa99c6c28464e1377b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesActionsTest-1690097821 Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 1fe2ae076eda4afa99c6c28464e1377b Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesActionsTest-1690097821 Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesActionsTest-1690097821-project Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 9201a1d107bf41959751e7d7c4e4d37d Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesActionsTest-1690097821-project Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 4b3c1240-94bc-4682-b211-6b628d2e63ff could not be found. Aug 03 18:53:12.242875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '4b3c1240-94bc-4682-b211-6b628d2e63ff'} Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3c1240-94bc-4682-b211-6b628d2e63ff could not be found. Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:53:12.243820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3c1240-94bc-4682-b211-6b628d2e63ff could not be found. Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3c1240-94bc-4682-b211-6b628d2e63ff could not be found. Aug 03 18:53:12.245321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:53:12.247217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] Returning 404 to user: Instance 4b3c1240-94bc-4682-b211-6b628d2e63ff could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:53:12.247769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-83bdc536-f3c3-403f-acca-1ce3dccdc42b tempest-VolumesActionsTest-1690097821 tempest-VolumesActionsTest-1690097821-project] 10.222.0.69 "GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff" status: 404 len: 111 microversion: 2.1 time: 0.080389 Aug 03 18:53:12.248965 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 219/445] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:12 2022] GET /compute/v2.1/servers/4b3c1240-94bc-4682-b211-6b628d2e63ff => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:53:12.706525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:12.707148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:12.725386 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:12.725857 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:12.726659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:12.727406 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:12.937838 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:12.947062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-21d2c066-5c8f-44f4-82ba-260b2b177470 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.246432 Aug 03 18:53:12.948972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 227/446] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:12 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:13.045265 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-b0a2a88c-5338-4b93-aa6d-2f10412fcad6 req-c29183e8-2037-4374-8a71-14e6c9e86171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc1c313-9332-403b-bbe5-63a6c2166815", "tag": "f1ac9290-e7c9-4c16-a9e9-ca539d39ba80"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:13.061790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b0a2a88c-5338-4b93-aa6d-2f10412fcad6 req-c29183e8-2037-4374-8a71-14e6c9e86171 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:13.062595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b0a2a88c-5338-4b93-aa6d-2f10412fcad6 req-c29183e8-2037-4374-8a71-14e6c9e86171 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:13.080545 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-b0a2a88c-5338-4b93-aa6d-2f10412fcad6 req-c29183e8-2037-4374-8a71-14e6c9e86171 service nova] Creating event network-changed:f1ac9290-e7c9-4c16-a9e9-ca539d39ba80 for instance 7cc1c313-9332-403b-bbe5-63a6c2166815 on hv-cinder-85164 Aug 03 18:53:13.087311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-b0a2a88c-5338-4b93-aa6d-2f10412fcad6 req-c29183e8-2037-4374-8a71-14e6c9e86171 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045626 Aug 03 18:53:13.087912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 220/447] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:13.976409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:13.977154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:13.984432 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:13.984879 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:13.986707 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:13.987191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:14.178347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:14.186323 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8d1020f0-1726-4cfa-bd97-31eef97310fe tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.213890 Aug 03 18:53:14.186889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 228/448] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:13 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:15.209524 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:15.210213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:15.216377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:15.216898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:15.217662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:15.218090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:15.383518 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:15.391957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a9809e05-2599-46fc-a469-5d92d7741381 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.187703 Aug 03 18:53:15.393314 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 221/449] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:15 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:16.413511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:16.414455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:16.420389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:16.420846 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:16.421627 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:16.422069 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:16.558354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:16.566061 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-83edd43c-e953-45b6-955b-a2ae6a5f6ee0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.156429 Aug 03 18:53:16.566647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 229/450] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:16 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:53:17.588846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:17.589451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:17.591883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=68 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:17.598418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:17.598865 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:17.599633 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:17.600062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:17.737925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:17.745399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2eed29bd-90c4-4f4d-899f-72195368276f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.160395 Aug 03 18:53:17.745990 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 222/451] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:17 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:18.766929 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:18.768059 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:18.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:18.774709 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:18.775472 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:18.775914 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:18.914674 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:18.922692 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b718134a-3617-4ebf-a7a3-ed30ba711e98 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.159586 Aug 03 18:53:18.923262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 230/452] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:18 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:19.943871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:19.944522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:19.946810 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:19.952179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:19.952667 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:19.953429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:19.953866 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:19.958119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:20.084271 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:20.091795 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c223a01a-9244-4005-b643-0db1b4e86947 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.152441 Aug 03 18:53:20.092373 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 223/453] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:19 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:21.114442 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:21.115164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:21.117024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:21.117687 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=10 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:21.124017 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:21.124548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:21.125318 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:21.125760 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:21.261051 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:21.269423 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-43135a42-9af6-4704-b5f1-0a8aeb845fda tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.159685 Aug 03 18:53:21.270001 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 231/454] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:21 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:22.291331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:22.291973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:22.298508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:22.298981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:22.299777 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:22.300209 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:22.439231 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:22.450204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-41313f36-1996-4473-85e7-b9c40f2562da tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.162590 Aug 03 18:53:22.450913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 224/455] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:22 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:23.473225 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:23.473842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:23.479906 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:23.480391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:23.481202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:23.481648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:23.632441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:23.639832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f728e965-2cae-40e0-b027-9ba72ccbb074 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.171167 Aug 03 18:53:23.640421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 232/456] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:23 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:24.668802 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:24.668802 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:24.673342 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:24.673800 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:24.677649 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:24.678467 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:25.411655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:25.425663 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2bc9d081-cf56-40c4-aab7-95cee363f72d tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.768185 Aug 03 18:53:25.428166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 225/457] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:24 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:26.451901 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:26.452612 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:26.457656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:26.461119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:26.461572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:26.462342 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:26.462778 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:26.670360 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:26.681112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b1e7373d-4c61-44bf-9067-72f84f64088a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.232815 Aug 03 18:53:26.696563 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 233/458] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:26 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:27.714060 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:27.728703 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:27.747695 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:27.748573 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:27.749776 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:27.750548 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:27.926453 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-d30da2a7-eab1-4a0c-9693-4ed5aff9589b req-ee5e0182-6937-4dff-be2e-8c4db9448b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc1c313-9332-403b-bbe5-63a6c2166815", "name": "network-vif-plugged", "status": "completed", "tag": "f1ac9290-e7c9-4c16-a9e9-ca539d39ba80"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:27.947286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-d30da2a7-eab1-4a0c-9693-4ed5aff9589b req-ee5e0182-6937-4dff-be2e-8c4db9448b9e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:27.947735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-d30da2a7-eab1-4a0c-9693-4ed5aff9589b req-ee5e0182-6937-4dff-be2e-8c4db9448b9e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:27.994884 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-d30da2a7-eab1-4a0c-9693-4ed5aff9589b req-ee5e0182-6937-4dff-be2e-8c4db9448b9e service nova] Creating event network-vif-plugged:f1ac9290-e7c9-4c16-a9e9-ca539d39ba80 for instance 7cc1c313-9332-403b-bbe5-63a6c2166815 on hv-cinder-85164 Aug 03 18:53:27.994884 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-d30da2a7-eab1-4a0c-9693-4ed5aff9589b req-ee5e0182-6937-4dff-be2e-8c4db9448b9e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071939 Aug 03 18:53:28.008034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 234/459] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:28.086984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:28.097055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-76d8f3b1-29cc-431e-aa1b-1eb9fc2f261c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.393977 Aug 03 18:53:28.098215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 226/460] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:27 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:29.122489 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:29.123527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:29.130331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:29.130789 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:29.131592 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:29.132044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:29.280800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:29.295165 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0156c77c-2e21-4091-b29a-b04a1f50e585 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.177076 Aug 03 18:53:29.295745 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 235/461] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:29 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:30.317606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:30.318943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:30.326178 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:30.326948 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:30.327910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:30.328562 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:30.478145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:30.486138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-96b58212-c4ab-4f89-bd4f-da35d05a8523 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.173513 Aug 03 18:53:30.487230 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 227/462] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:30 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:31.507877 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:31.509188 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:31.515427 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:31.516102 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:31.516902 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:31.517345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:31.663276 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:31.671402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6edbd861-1ad5-43f3-a44b-2c9ca477db1a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.167750 Aug 03 18:53:31.671973 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 236/463] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:31 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:32.693771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:32.694481 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:32.701790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:32.702348 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:32.703208 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:32.703720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:32.862319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:32.870583 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cb0b6a71-3d58-4aa4-b1d8-cf8c11c721c0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.181419 Aug 03 18:53:32.871203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 228/464] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:32 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:33.892332 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:33.893576 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:33.906965 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:33.907418 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:33.908434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:33.909173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:34.081213 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:34.089600 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b5d6ab6f-2378-481a-9064-21329e68fde6 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.201306 Aug 03 18:53:34.090426 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 237/465] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:33 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:35.114224 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:35.115774 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:35.123293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:35.124020 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:35.125051 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:35.125691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:35.266297 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:35.275758 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ae71bf45-e5a6-4451-bf2f-70634cb99b2c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1369 microversion: 2.1 time: 0.166069 Aug 03 18:53:35.276355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 229/466] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:35 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:53:36.299295 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:36.300773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:36.307268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:36.307808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:36.308728 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:36.309460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:36.473995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:53:36.482473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-50299a3e-5acc-4d6c-8b92-4c227f355534 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1562 microversion: 2.1 time: 0.187355 Aug 03 18:53:36.483046 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 238/467] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:53:36 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:53:36.514166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b4942d53-d462-47dd-8a26-557c2150e81a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:53:36.514805 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b4942d53-d462-47dd-8a26-557c2150e81a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:36.523247 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b4942d53-d462-47dd-8a26-557c2150e81a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:36.523701 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b4942d53-d462-47dd-8a26-557c2150e81a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:36.524592 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b4942d53-d462-47dd-8a26-557c2150e81a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:36.525031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b4942d53-d462-47dd-8a26-557c2150e81a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:36.620242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b4942d53-d462-47dd-8a26-557c2150e81a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113992 Aug 03 18:53:36.621665 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 230/468] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 18:53:36 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:37.796465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-81437ef0-e327-44f0-b0af-d0875bb35476 req-ab84f170-4822-4ffb-9372-052f22ea3190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc1c313-9332-403b-bbe5-63a6c2166815", "tag": "f1ac9290-e7c9-4c16-a9e9-ca539d39ba80"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:37.807971 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-81437ef0-e327-44f0-b0af-d0875bb35476 req-ab84f170-4822-4ffb-9372-052f22ea3190 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:37.808547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-81437ef0-e327-44f0-b0af-d0875bb35476 req-ab84f170-4822-4ffb-9372-052f22ea3190 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:37.821803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-81437ef0-e327-44f0-b0af-d0875bb35476 req-ab84f170-4822-4ffb-9372-052f22ea3190 service nova] Creating event network-changed:f1ac9290-e7c9-4c16-a9e9-ca539d39ba80 for instance 7cc1c313-9332-403b-bbe5-63a6c2166815 on hv-cinder-85164 Aug 03 18:53:37.828034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-81437ef0-e327-44f0-b0af-d0875bb35476 req-ab84f170-4822-4ffb-9372-052f22ea3190 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035168 Aug 03 18:53:37.828725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 239/469] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:50.244690 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=17 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:50.245423 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=44 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:53:50.250958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c7174ee8-0c9f-4b14-8581-e0fc0cfb59f9 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33d9602a-ef3e-4e0f-baf5-b3e116493b1e", "device": "/dev/sdb"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:53:50.255935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c7174ee8-0c9f-4b14-8581-e0fc0cfb59f9 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:53:50.262734 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7174ee8-0c9f-4b14-8581-e0fc0cfb59f9 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:50.263183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7174ee8-0c9f-4b14-8581-e0fc0cfb59f9 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:50.263948 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7174ee8-0c9f-4b14-8581-e0fc0cfb59f9 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:53:50.264409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c7174ee8-0c9f-4b14-8581-e0fc0cfb59f9 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:53:50.616325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c7174ee8-0c9f-4b14-8581-e0fc0cfb59f9 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "POST /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372843 Aug 03 18:53:50.617028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 231/470] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 18:53:50 2022] POST /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:53:50.663428 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 18:53:50.663662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 18:53:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 18:54:24.858304 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=13 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:24.859773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=70 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:24.867035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:24.868559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:24.894471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:24.895057 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:24.896559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:24.897023 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:25.091562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lazy-loading 'services' on Instance uuid 7524e55b-5314-4845-ba1e-2a0b21471f4f {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:54:25.348183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-42e8c9cb-d643-46d9-bb1e-bc9998450169 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f/os-volume_attachments/33d9602a-ef3e-4e0f-baf5-b3e116493b1e" status: 202 len: 0 microversion: 2.1 time: 0.490655 Aug 03 18:54:25.348969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 240/471] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 18:54:24 2022] DELETE /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f/os-volume_attachments/33d9602a-ef3e-4e0f-baf5-b3e116493b1e => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:54:26.565162 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:26.565752 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:26.568212 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:26.568918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:26.582076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:26.582638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:26.584350 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:26.584909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:26.618935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:54:26.728857 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a0f927ea-4b89-45c4-a47f-56eb2fec5f9a tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 204 len: 0 microversion: 2.1 time: 0.167366 Aug 03 18:54:26.729791 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 232/472] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:54:26 2022] DELETE /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:54:26.739940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:26.741395 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:26.748907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:26.749498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:26.750389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:26.750932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:26.914209 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:26.943299 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-32ee3e6f-c1f2-454f-8bff-515e3b638d1f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1514 microversion: 2.1 time: 0.207661 Aug 03 18:54:26.943897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 241/473] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:26 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:27.965987 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:27.966692 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:27.973397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:27.973853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:27.974626 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:27.975065 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:28.133664 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:28.145152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9a542907-fa6e-4db1-989b-530597d929f4 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1514 microversion: 2.1 time: 0.184042 Aug 03 18:54:28.145887 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 233/474] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:27 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:29.169603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:29.170860 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:29.184076 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:29.184871 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:29.190573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:29.191264 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:29.518898 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:29.527187 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ce80c3c7-15d0-4ebd-8e6d-a41458727f9d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1514 microversion: 2.1 time: 0.364029 Aug 03 18:54:29.530325 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 242/475] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:29 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:30.043652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-8f678f33-89d4-4283-b909-ef110b0cb809 req-8b600fe3-d394-4870-b23e-4b092cb1ffd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7524e55b-5314-4845-ba1e-2a0b21471f4f", "name": "network-vif-deleted", "tag": "a3cd344b-efd7-47ed-94de-5b9a2dedc1ea"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:54:30.055979 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-8f678f33-89d4-4283-b909-ef110b0cb809 req-8b600fe3-d394-4870-b23e-4b092cb1ffd5 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:30.056811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-8f678f33-89d4-4283-b909-ef110b0cb809 req-8b600fe3-d394-4870-b23e-4b092cb1ffd5 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:30.071196 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-8f678f33-89d4-4283-b909-ef110b0cb809 req-8b600fe3-d394-4870-b23e-4b092cb1ffd5 service nova] Creating event network-vif-deleted:a3cd344b-efd7-47ed-94de-5b9a2dedc1ea for instance 7524e55b-5314-4845-ba1e-2a0b21471f4f on hv-cinder-85164 Aug 03 18:54:30.077397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-8f678f33-89d4-4283-b909-ef110b0cb809 req-8b600fe3-d394-4870-b23e-4b092cb1ffd5 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Aug 03 18:54:30.082126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 234/476] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:54:30.551370 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:30.552803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:30.562238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:30.564816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:30.565875 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:30.568282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:30.635158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:30.636602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:30.637733 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lazy-loading 'fault' on Instance uuid 7524e55b-5314-4845-ba1e-2a0b21471f4f {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:54:30.695792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:30.714958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e880cdee-3327-43de-9ccd-302dea024c7f tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 200 len: 1309 microversion: 2.1 time: 0.167694 Aug 03 18:54:30.717578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 243/477] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:30 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 1309 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:31.741728 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:31.743156 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: 7524e55b-5314-4845-ba1e-2a0b21471f4f] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:31.750264 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:31.750709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:31.751685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:31.752275 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:31.767889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] HTTP exception thrown: Instance 7524e55b-5314-4845-ba1e-2a0b21471f4f could not be found. Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Request method failure captured: Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f HTTP/1.1 Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sPsIT9059_WfTOsZM2HSf_TLoBBVC7OchV6mjoowNC0mfzcSC_fmNs7r1cm59Q8IwDXWWFBZm_xt23Yygffc0PsN11ySD-9Q1LSGT-st60PdoCxvEM0P9h6FSCdVtJXslkRKLQ_au09scRHcyn4f0FbYyXIUcR6zVy_ZCzJxgJs2_s Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 653198c47b6a4f68b5ac4932b02b95d0 Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2127092173 Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:54:31.769693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesSnapshotTestJSON-2127092173 Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 653198c47b6a4f68b5ac4932b02b95d0 Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2127092173 Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesSnapshotTestJSON-2127092173-project Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: fe100dded4484be3981b33384f4c68b2 Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesSnapshotTestJSON-2127092173-project Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 7524e55b-5314-4845-ba1e-2a0b21471f4f could not be found. Aug 03 18:54:31.771281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '7524e55b-5314-4845-ba1e-2a0b21471f4f'} Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7524e55b-5314-4845-ba1e-2a0b21471f4f could not be found. Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:54:31.772219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7524e55b-5314-4845-ba1e-2a0b21471f4f could not be found. Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7524e55b-5314-4845-ba1e-2a0b21471f4f could not be found. Aug 03 18:54:31.774925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:54:31.776913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Returning 404 to user: Instance 7524e55b-5314-4845-ba1e-2a0b21471f4f could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:54:31.777918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-398fa01a-a5cb-40f2-ba39-f2157dc35ca5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f" status: 404 len: 111 microversion: 2.1 time: 0.042648 Aug 03 18:54:31.778762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 235/478] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:31 2022] GET /compute/v2.1/servers/7524e55b-5314-4845-ba1e-2a0b21471f4f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:54:36.975737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-10ba42bd-62c4-4d60-85ec-42928b569f74 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Action: 'create', calling method: .version_select at 0x7fdaca0f89d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1325982020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7tFMfte7OnFHRAkrcs/5qAnrEtgI0skmYt0UPNSuiTtovw6PuioIcatq1r66DPCz6GXDbN3uUwHXLTonOHOw+2otmw9PGyDMjx1ksqiyHsKvwgiIMSMm0A4R7hPh2aGA=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:54:36.991206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-10ba42bd-62c4-4d60-85ec-42928b569f74 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Getting quotas for project 182c4b8842bb4aa1a31fbd603c52b276. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:54:36.995627 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-10ba42bd-62c4-4d60-85ec-42928b569f74 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Getting quotas for user effc38ce5cd6441b92ed3bbb2eaee76c and project 182c4b8842bb4aa1a31fbd603c52b276. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:54:37.017697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-10ba42bd-62c4-4d60-85ec-42928b569f74 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045837 Aug 03 18:54:37.018289 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 244/479] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 18:54:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:54:37.071197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1610518522", "imageRef": "643bc1b6-3030-4b53-90b2-d991fe2d1a72", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1325982020", "networks": [{"uuid": "fa8d6f73-34bd-4f74-957d-2d453a25c914"}]}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:54:37.126648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] validate_networks() for [('fa8d6f73-34bd-4f74-957d-2d453a25c914', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:54:37.279529 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-48d281be-e8a3-4eae-9e95-8770e10c83c2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:37.280341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-48d281be-e8a3-4eae-9e95-8770e10c83c2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:37.286582 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48d281be-e8a3-4eae-9e95-8770e10c83c2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:37.287176 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48d281be-e8a3-4eae-9e95-8770e10c83c2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:37.288039 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48d281be-e8a3-4eae-9e95-8770e10c83c2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:37.289124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-48d281be-e8a3-4eae-9e95-8770e10c83c2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:37.318864 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-48d281be-e8a3-4eae-9e95-8770e10c83c2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/ips" status: 200 len: 145 microversion: 2.1 time: 0.044237 Aug 03 18:54:37.319449 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 245/480] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 18:54:37 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:54:37.527095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:54:37.527513 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:54:37.527985 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:54:37.528440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:54:37.528859 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:54:37.537873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:37.538319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:37.539765 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:37.540199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:37.556887 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Getting quotas for project 182c4b8842bb4aa1a31fbd603c52b276. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:54:37.560904 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Getting quotas for user effc38ce5cd6441b92ed3bbb2eaee76c and project 182c4b8842bb4aa1a31fbd603c52b276. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:54:37.571945 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:54:37.574220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='643bc1b6-3030-4b53-90b2-d991fe2d1a72',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:54:37.623409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3770912a-15ed-4bdd-9a29-287256f7f52e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556253 Aug 03 18:54:37.629846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 236/481] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:54:37.636339 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e853d8e6-f24d-4bb0-8904-0654fd40ddc7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:37.636964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e853d8e6-f24d-4bb0-8904-0654fd40ddc7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:37.693865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e853d8e6-f24d-4bb0-8904-0654fd40ddc7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:37.700939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e853d8e6-f24d-4bb0-8904-0654fd40ddc7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1259 microversion: 2.1 time: 0.069564 Aug 03 18:54:37.701501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 246/482] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:37 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:38.722587 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:38.723239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:38.732374 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:38.733115 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:38.734022 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:38.734453 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:38.801723 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:38.812878 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b9dc343b-d581-40ce-a517-40aa7b6972bd tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1319 microversion: 2.1 time: 0.094436 Aug 03 18:54:38.813652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 237/483] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:38 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:39.752385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8b4d6b94-b1fc-4857-9996-2482989beb41 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:39.753217 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8b4d6b94-b1fc-4857-9996-2482989beb41 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:39.759386 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b4d6b94-b1fc-4857-9996-2482989beb41 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:39.759831 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b4d6b94-b1fc-4857-9996-2482989beb41 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:39.761245 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b4d6b94-b1fc-4857-9996-2482989beb41 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:39.761697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8b4d6b94-b1fc-4857-9996-2482989beb41 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:39.786651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8b4d6b94-b1fc-4857-9996-2482989beb41 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/ips" status: 200 len: 151 microversion: 2.20 time: 0.038247 Aug 03 18:54:39.787770 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 247/484] 10.222.0.69 () {60 vars in 1289 bytes} [Wed Aug 3 18:54:39 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:54:39.838409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:39.839037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:39.848107 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:39.849001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:39.850023 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:39.850624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:40.021259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:40.032965 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c35f36ca-dced-4de4-9046-aae68b7ed30b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.201613 Aug 03 18:54:40.034418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 238/485] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:39 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:41.055855 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:41.057525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:41.065614 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:41.066402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:41.067785 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:41.069182 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:41.208997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:41.216987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e4d43746-815b-4d3f-8821-5254e730cc9b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.165937 Aug 03 18:54:41.217550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 248/486] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:41 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:42.237451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:42.238613 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:42.247689 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:42.248142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:42.248955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:42.249395 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:42.393910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:42.402532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0c834b15-0238-428b-b828-a4320d69ae04 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.168926 Aug 03 18:54:42.403377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 239/487] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:42 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:43.423593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:43.424209 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:43.430885 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:43.431341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:43.432109 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:43.432570 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:43.560309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:43.567834 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1ff10c99-6523-4dca-a17c-f53921beec5d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.148237 Aug 03 18:54:43.568419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 249/488] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:43 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:44.590106 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:44.590655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:44.597144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:44.597592 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:44.598350 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:44.598787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:44.739691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:44.747395 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d83d6a6e-04f1-47c4-ace1-5bce7e559456 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.161903 Aug 03 18:54:44.780452 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 240/489] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:44 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:44.850987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-947457801", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "networks": [{"uuid": "1ae3fbdf-65ac-4c67-b4ab-2cb923cbdc95"}]}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:54:44.910121 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] validate_networks() for [('1ae3fbdf-65ac-4c67-b4ab-2cb923cbdc95', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:54:45.272929 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:54:45.273974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:54:45.273974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:54:45.274254 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:54:45.274818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:54:45.283754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:45.284201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:45.285032 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:45.285473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:45.302062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Getting quotas for project 653198c47b6a4f68b5ac4932b02b95d0. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:54:45.306578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Getting quotas for user fe100dded4484be3981b33384f4c68b2 and project 653198c47b6a4f68b5ac4932b02b95d0. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:54:45.317361 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:54:45.319628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:54:45.381311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2c00aab8-e8c9-4855-9d4a-2ba782c20e0b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534098 Aug 03 18:54:45.382201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 250/490] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:54:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:54:45.394921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fd7e86a4-8371-4b2b-8b12-047050ecfb76 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:45.395621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fd7e86a4-8371-4b2b-8b12-047050ecfb76 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:45.406663 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-71d99daa-5f80-406c-ae62-ec25fb7e1be7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07eaca3f-be37-4749-8b94-64d746b1a814"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:54:45.409265 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-71d99daa-5f80-406c-ae62-ec25fb7e1be7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:45.419584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d99daa-5f80-406c-ae62-ec25fb7e1be7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:45.420048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d99daa-5f80-406c-ae62-ec25fb7e1be7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:45.420803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d99daa-5f80-406c-ae62-ec25fb7e1be7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:45.421353 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d99daa-5f80-406c-ae62-ec25fb7e1be7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:45.485449 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fd7e86a4-8371-4b2b-8b12-047050ecfb76 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:45.508404 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fd7e86a4-8371-4b2b-8b12-047050ecfb76 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1218 microversion: 2.1 time: 0.117860 Aug 03 18:54:45.508838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 241/491] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:45 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:45.769486 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:45.770160 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:45.780792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:45.781486 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:45.782254 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:45.782688 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:45.938977 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:45.947743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-79ed1f05-f26e-4fe4-a0cb-8f5ff7dd0644 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.182053 Aug 03 18:54:45.948344 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 242/492] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:45 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:46.529159 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:46.529966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:46.536606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:46.537062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:46.538023 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:46.539152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:46.610530 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:46.622261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-de76a44e-4791-4c8c-9a3d-a8c05f508d8e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.097047 Aug 03 18:54:46.623214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 243/493] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:46 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:46.970312 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:46.971144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:46.977941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:46.978413 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:46.979198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:46.979639 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:47.119213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:47.126873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-18a36476-cd55-4f24-9b19-88898399fc27 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.161088 Aug 03 18:54:47.127446 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 244/494] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:46 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:47.133424 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:54:47.133961 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:47.140077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:47.140567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:47.141341 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:47.141779 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:47.166877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lazy-loading 'flavor' on Instance uuid 75afca33-3ec7-4c03-9d25-a247fc1e47bd {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:54:47.349506 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a60d7dc7-fda1-4a9a-a382-30f9d963a588 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/action" status: 202 len: 0 microversion: 2.20 time: 0.220321 Aug 03 18:54:47.350096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 245/495] 10.222.0.69 () {62 vars in 1319 bytes} [Wed Aug 3 18:54:47 2022] POST /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:54:47.358549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:47.359262 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:47.366056 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:47.367148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:47.368114 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:47.368586 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:47.511178 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:47.519173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:47.520731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:47.521880 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b0a9c54f-a259-41b5-9b7a-84d67b0fc5e1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.167308 Aug 03 18:54:47.522434 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 246/496] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:47 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:47.663742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:47.664419 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:47.666418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:47.672112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:47.672589 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:47.673355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:47.673795 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:47.741199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:47.744780 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:47.749872 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-aaecbf51-4702-4714-b196-d54034a96fb8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.090227 Aug 03 18:54:47.750451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 247/497] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:47 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:48.154282 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:48.155440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:48.167520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:48.168251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:48.169431 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:48.170161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:48.325435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:48.333460 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3fe67f28-0b47-4afc-9b6a-1c556453000c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.186970 Aug 03 18:54:48.334051 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 248/498] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:48 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:48.546077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:48.546595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:48.552621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:48.553065 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:48.553812 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:48.555428 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:48.691943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:48.700498 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:48.702014 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:48.703183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4b327309-a6ae-4a49-a013-3c7fefbe2210 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.161081 Aug 03 18:54:48.703745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 249/499] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:48 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:54:48.772246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:48.773861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:48.783068 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:48.783662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:48.785372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:48.785372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:48.857101 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:48.865784 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5c1333d1-3208-4797-b263-986b15845710 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.097320 Aug 03 18:54:48.866536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 250/500] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:48 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:49.355797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:49.356608 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:49.363761 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:49.364213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:49.365033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:49.365470 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:49.513758 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:49.521370 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-20443d30-35fe-4f62-9b00-286cedffe55e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.169444 Aug 03 18:54:49.521944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 251/501] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:49 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:49.726676 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:49.727293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:49.734281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:49.734851 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:49.735680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:49.736127 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:49.899148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:49.907578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:49.909311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:49.910599 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-059fb6c9-8851-4019-86c6-fdef11db8242 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.188081 Aug 03 18:54:49.919868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 252/502] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:49 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:49.922122 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:49.922846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:49.930512 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:49.930957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:49.932062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:49.932553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:49.998520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:50.006500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c35a2c61-7bbb-4c56-80a2-4fb8b6155946 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.088314 Aug 03 18:54:50.007423 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 253/503] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:49 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:50.542241 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:50.543069 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:50.551202 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:50.551648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:50.552438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:50.552872 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:50.696823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:50.704399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-110161fe-2552-4569-b5cc-24d626259c5c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.166017 Aug 03 18:54:50.704958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 254/504] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:50 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:50.935681 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:50.936282 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:50.942539 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:50.942983 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:50.943787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:50.944223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:51.079802 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:51.088205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:51.089850 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:51.090997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c808d62e-2273-4f90-a623-65f5ee79df4c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.159369 Aug 03 18:54:51.091554 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 255/505] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:50 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:51.095813 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:51.096432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:51.102831 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:51.103281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:51.104058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:51.104614 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:51.170720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:51.178082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b1c28666-72ee-42b9-a0d1-458995871110 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.085607 Aug 03 18:54:51.179910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 256/506] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:51 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:51.727182 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:51.727981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:51.734364 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:51.734806 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:51.735577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:51.736004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:51.876040 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:51.883936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a9b8a5a5-94a9-47e9-897d-b56cda4a7feb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.162244 Aug 03 18:54:51.884548 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 257/507] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:51 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:52.114292 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:52.114853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:52.121271 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:52.121726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:52.122491 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:52.122930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:52.256947 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:52.266037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:52.267552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:52.268747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dceaec58-cf63-46ab-8bf0-da4b3e12415e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.158526 Aug 03 18:54:52.269338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 258/508] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:52 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:52.273737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:52.275122 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:52.280967 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:52.281418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:52.282184 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:52.282625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:52.349694 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:52.357432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3ec08bca-dd19-43e7-8613-42b743986850 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.087136 Aug 03 18:54:52.358015 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 259/509] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:52 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:52.905431 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:52.906239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:52.912681 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:52.913135 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:52.913899 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:52.914332 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:53.051079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:53.059862 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-bdbc77d1-c9fc-4be8-a403-9c2fd2e26e4a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.158278 Aug 03 18:54:53.065198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 260/510] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:52 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:53.293999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:53.294602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:53.300594 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:53.301032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:53.301781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:53.302211 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:53.437045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:53.453055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:53.454845 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:53.456240 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f8fb8153-7d6b-457d-81df-34373ac78c14 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.166753 Aug 03 18:54:53.457072 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 261/511] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:53 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:53.461684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:53.462335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:53.468583 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:53.469042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:53.469815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:53.470249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:53.536206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:53.545159 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e9308e64-2ecc-45ce-8cf1-2352c2baeea0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.087199 Aug 03 18:54:53.545662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 262/512] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:53 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:54.080948 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:54.081684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:54.088986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:54.089438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:54.090200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:54.090632 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:54.222673 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:54.232047 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8a0c00ff-54e0-4ea7-99f9-3194d5c639fa tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.155200 Aug 03 18:54:54.232660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 263/513] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:54 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:54.479671 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:54.480203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:54.486296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:54.486749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:54.487510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:54.487947 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:54.506949 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:54.629063 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:54.637627 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:54.639156 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:54.640341 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6dec8cf6-ccaf-4be4-982a-551ead129ef1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.165213 Aug 03 18:54:54.640901 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 264/514] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:54 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:54.645233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:54.645843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:54.651538 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:54.651993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:54.652823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:54.653265 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:54.717195 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:54.724620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2d81ae94-c647-40bd-8dc0-7aa18b2a9201 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.082722 Aug 03 18:54:54.725184 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 265/515] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:54 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:55.253582 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:55.254262 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:55.261248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:55.261693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:55.262441 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:55.262871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:55.293158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:55.313000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=12 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:55.401518 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:55.409037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-bcd19b23-7aae-4122-a10f-5a408b1a7a89 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.160165 Aug 03 18:54:55.409611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 266/516] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:55 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:55.414451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:55.563144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:55.663365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:55.663979 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:55.666619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=8 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:55.675483 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:55.675927 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:55.676724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:55.677155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:55.807651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:55.815467 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:55.817027 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:55.818167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9a3c8929-278b-498f-b68f-7aa51923b610 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.158752 Aug 03 18:54:55.818716 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 267/517] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:55 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:55.823708 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:55.824414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:55.830055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:55.830502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:55.831250 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:55.831680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:55.898235 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:55.907033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a36054f5-c60a-45af-b3f6-e113e961f395 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.087365 Aug 03 18:54:55.907598 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 268/518] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:55 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:56.430881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:56.431593 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:56.434998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:54:56.438619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:56.439074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:56.439845 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:56.440300 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:56.570425 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:56.578613 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b6cf7d21-b084-4e3a-baee-f3acef2a8949 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.151600 Aug 03 18:54:56.579180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 269/519] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:56 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:54:56.842185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:56.842710 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:56.848740 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:56.849180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:56.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:56.851431 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:56.982853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:56.990691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:56.992193 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:56.993467 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d5e0c6f5-0e3e-45cf-9a5c-2e5cb24f96d1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.155223 Aug 03 18:54:56.994223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 270/520] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:56 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:56.998543 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:56.999145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:57.005179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:57.005627 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:57.006381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:57.006817 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:57.073094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:57.082055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-afedf6da-aad2-4407-943c-141b40c9af12 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1222 microversion: 2.1 time: 0.086739 Aug 03 18:54:57.092381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 271/521] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:56 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:57.498998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-71d99daa-5f80-406c-ae62-ec25fb7e1be7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.098378 Aug 03 18:54:57.499833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 251/522] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 18:54:45 2022] POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-volume_attachments => generated 194 bytes in 12100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:54:57.600408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:57.601066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:57.609673 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:57.610132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:57.610919 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:57.611360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:57.723710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-f3f55a81-f5f8-4609-9f50-38c865b37580 req-beaac10b-6c43-40eb-abea-8abb0eb5f0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e36937-1f1d-4b7a-ae8b-df0940da9613", "tag": "63b75436-6d6d-448e-9e4b-b87c4d33b454"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:54:57.734862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f3f55a81-f5f8-4609-9f50-38c865b37580 req-beaac10b-6c43-40eb-abea-8abb0eb5f0bf service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:57.735581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f3f55a81-f5f8-4609-9f50-38c865b37580 req-beaac10b-6c43-40eb-abea-8abb0eb5f0bf service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:57.748115 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-f3f55a81-f5f8-4609-9f50-38c865b37580 req-beaac10b-6c43-40eb-abea-8abb0eb5f0bf service nova] Creating event network-changed:63b75436-6d6d-448e-9e4b-b87c4d33b454 for instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 on hv-cinder-85164 Aug 03 18:54:57.749586 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:57.753685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-f3f55a81-f5f8-4609-9f50-38c865b37580 req-beaac10b-6c43-40eb-abea-8abb0eb5f0bf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 Aug 03 18:54:57.754279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 252/523] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:54:57.758952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0af96494-04ef-409b-a094-ee81fbd1a56e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.162841 Aug 03 18:54:57.760018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 272/524] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:57 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:58.018243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:58.019028 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:58.025451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:58.025917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:58.026681 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:58.027122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:58.108196 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:58.108839 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:58.115927 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:58.116402 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:58.117170 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:58.117603 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:58.268519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:58.278031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:58.279980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-46450043-249c-4459-ba8f-209d069d22fd tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1278 microversion: 2.1 time: 0.175508 Aug 03 18:54:58.281795 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 273/525] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:58 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:58.287981 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:58.289683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:58.292939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e66260af-3182-4905-aa14-7d621c2a3957 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.279281 Aug 03 18:54:58.294853 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 253/526] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:58 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:54:58.783578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:58.784202 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:58.801540 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:58.802249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:58.803412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:58.804011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:59.033307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:59.042762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7ba2485c-b246-400f-82d1-79b5cc22ff69 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.266240 Aug 03 18:54:59.052482 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 274/527] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:58 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:54:59.310633 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:59.317075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:54:59.317971 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:59.321011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:54:59.326809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:59.332035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:59.332930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:59.333918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:59.334561 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:59.335936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:59.338202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:54:59.338668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:54:59.779249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:59.786400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:59.787598 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:59.789199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:54:59.791347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-186619bf-4b7b-4b11-9c7a-f505d9f826ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.477439 Aug 03 18:54:59.792003 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 275/528] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:54:59 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:54:59.809960 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-705ae0f2-0df8-40d7-838d-8c0ade11afd8 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.504124 Aug 03 18:54:59.810549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 254/529] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:54:59 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:00.032606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-9e28d507-63f0-4f98-89a0-662b4307aa33 req-09360b2e-d392-4a12-86cc-9217acaddff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba47ebe6-9d28-4b13-9821-c97069a6599c", "tag": "4741e5d0-0230-45b4-bb81-f5d66890db08"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:00.043110 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9e28d507-63f0-4f98-89a0-662b4307aa33 req-09360b2e-d392-4a12-86cc-9217acaddff3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:00.043550 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9e28d507-63f0-4f98-89a0-662b4307aa33 req-09360b2e-d392-4a12-86cc-9217acaddff3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:00.054997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-9e28d507-63f0-4f98-89a0-662b4307aa33 req-09360b2e-d392-4a12-86cc-9217acaddff3 service nova] Creating event network-changed:4741e5d0-0230-45b4-bb81-f5d66890db08 for instance ba47ebe6-9d28-4b13-9821-c97069a6599c on hv-cinder-85164 Aug 03 18:55:00.061392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-9e28d507-63f0-4f98-89a0-662b4307aa33 req-09360b2e-d392-4a12-86cc-9217acaddff3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032347 Aug 03 18:55:00.061981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 276/530] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:00.063749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:00.064549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:00.070508 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:00.070966 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:00.072558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:00.073105 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:00.206487 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:00.214776 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a44a5efc-03fe-4eeb-ab9b-14f83fee31e7 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.155645 Aug 03 18:55:00.215349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 255/531] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:00 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:00.815466 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:00.816169 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:00.823107 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:00.823570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:00.824350 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:00.824795 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:00.832448 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:00.833063 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:00.839527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:00.839978 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:00.840790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:00.841227 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:01.019074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:01.027308 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:01.028852 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:01.030021 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4da5df11-622e-41ee-a96f-f15c254ff719 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.218765 Aug 03 18:55:01.030588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 277/532] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:00 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:01.042950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:01.050161 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-94bdaf35-1fe6-40f8-996b-7b8a6da579bb tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.221509 Aug 03 18:55:01.050721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 256/533] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:00 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:01.235328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:01.235875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:01.242914 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:01.244173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:01.245232 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:01.245663 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:01.381524 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:01.389131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ff69f923-0ffa-4f34-9e28-b778f1e292ba tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.157847 Aug 03 18:55:01.389700 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 278/534] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:01 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:02.053681 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:02.054230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:02.060612 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:02.061085 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:02.061839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:02.062286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:02.071745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:02.072535 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:02.078671 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:02.079121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:02.079889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:02.080358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:02.258736 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:02.267889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:02.269439 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:02.270595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f34a80c1-3850-4535-b800-5fe717946e04 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.220929 Aug 03 18:55:02.271154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 257/535] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:02 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:02.280724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:02.288167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-560d165e-d324-4643-ba38-04015492c4f7 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.220724 Aug 03 18:55:02.288777 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 279/536] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:02 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:02.410243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:02.410764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:02.417025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:02.417476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:02.418238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:02.418675 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:02.550207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:02.558681 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0e0bdb9c-3560-47b9-9530-cc2e4fc625a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.152337 Aug 03 18:55:02.559246 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 258/537] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:02 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:03.293895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:03.294524 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:03.304395 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:03.306905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:03.308871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:03.309439 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:03.310800 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:03.310996 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:03.318010 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:03.318465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:03.319244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:03.320238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:03.649816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:03.654990 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:03.658590 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b0feb173-0884-4613-beef-f41aa128b62b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.353932 Aug 03 18:55:03.662787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 259/538] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:03 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:03.664039 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:03.664894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:03.667748 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:03.669511 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:03.670917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4ddc284a-b35b-44b3-86c2-d48710b8502f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.381580 Aug 03 18:55:03.676601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:03.676601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:03.676601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:03.676601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:03.676973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 280/539] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:03 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:03.848720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:03.857564 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2595b13b-e367-43b0-897c-54142c966901 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.197077 Aug 03 18:55:03.866750 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 260/540] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:03 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:04.680235 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:04.680808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:04.687314 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:04.687767 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:04.688572 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:04.689012 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:04.694754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:04.695363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:04.703067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:04.703498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:04.704261 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:04.704892 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:04.890102 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:04.893806 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:04.894850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:04.898472 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b6609296-0909-4b20-8778-f5572d8ed54d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.222125 Aug 03 18:55:04.899048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 281/541] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:04 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:04.904385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:04.908573 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:04.909191 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:04.914987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:04.915968 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:04.916209 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9ac31a5a-355b-4329-9ca5-28d7f986cced tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.225283 Aug 03 18:55:04.916482 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:04.917265 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:04.917826 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:04.928166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 261/542] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:04 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:05.061647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:05.069018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9a6e3f03-0117-4c5c-97d4-170a3a53d437 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.169030 Aug 03 18:55:05.069588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 282/543] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:04 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:05.921065 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:05.921679 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:05.928223 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:05.928705 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:05.929467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:05.929899 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:05.950902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:05.951688 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:05.958495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:05.958947 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:05.959753 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:05.960195 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:06.130934 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:06.139089 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-09e748f5-a3ad-444f-a93a-cdada479b802 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.222635 Aug 03 18:55:06.139763 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 262/544] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:05 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:06.144229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:06.144929 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:06.148585 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:06.151449 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:06.151926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:06.152721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:06.153158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:06.158517 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:06.160164 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:06.161392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0d29f995-ed28-4cb5-8a9a-2ed591adb73e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.214916 Aug 03 18:55:06.161951 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 283/545] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:05 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:06.284343 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:06.292034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d6b55892-d46a-49d5-a8f7-9ddd2b089c7e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.151023 Aug 03 18:55:06.292613 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 263/546] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:06 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:07.025809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-88842c1d-8bcb-47c7-924f-2e5024a39629 req-ec26ad37-dba4-4730-8bff-69a372850d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e36937-1f1d-4b7a-ae8b-df0940da9613", "name": "network-vif-plugged", "status": "completed", "tag": "63b75436-6d6d-448e-9e4b-b87c4d33b454"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:07.037271 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-88842c1d-8bcb-47c7-924f-2e5024a39629 req-ec26ad37-dba4-4730-8bff-69a372850d7d service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:07.037724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-88842c1d-8bcb-47c7-924f-2e5024a39629 req-ec26ad37-dba4-4730-8bff-69a372850d7d service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:07.050057 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-88842c1d-8bcb-47c7-924f-2e5024a39629 req-ec26ad37-dba4-4730-8bff-69a372850d7d service nova] Creating event network-vif-plugged:63b75436-6d6d-448e-9e4b-b87c4d33b454 for instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 on hv-cinder-85164 Aug 03 18:55:07.055497 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-88842c1d-8bcb-47c7-924f-2e5024a39629 req-ec26ad37-dba4-4730-8bff-69a372850d7d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034037 Aug 03 18:55:07.056417 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 284/547] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:07.160886 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:07.161425 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:07.168767 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:07.169213 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:07.169964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:07.170393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:07.185887 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:07.186604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:07.192833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:07.193285 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:07.194043 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:07.194485 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:07.372586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:07.380095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:07.380495 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b7fac523-c84d-40d3-8094-a49669447485 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.223426 Aug 03 18:55:07.381076 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 264/548] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:07 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:07.385734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:07.386377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:07.388955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:07.390450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:07.391607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e9f4ba5e-f832-466f-afcd-c279f5da4383 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.210572 Aug 03 18:55:07.392349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 285/549] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:07 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:07.392475 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:07.392730 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:07.393511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:07.393951 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:07.525691 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:07.533249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3898902f-0017-4fb4-8773-848ae804469a tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.151222 Aug 03 18:55:07.533819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 265/550] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:07 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:08.402976 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:08.403682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:08.410704 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:08.411166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:08.411971 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:08.412438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:08.415124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:08.416141 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:08.423021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:08.423474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:08.424346 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:08.424793 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:08.615236 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:08.618367 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:08.623789 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d31e7e22-a614-4953-b1e1-0dfb1cdfb494 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.225682 Aug 03 18:55:08.628327 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 286/551] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:08 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:08.628469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:08.629132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:08.629743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:08.629895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:08.631940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b2620b56-cb88-42d0-affe-38ad28b57c51 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.220671 Aug 03 18:55:08.632727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 266/552] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:08 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:08.635804 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:08.636257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:08.637066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:08.637503 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:08.770454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:08.777917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8c004c8a-851c-4cab-8b9d-3849e34c8ea2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.152501 Aug 03 18:55:08.778490 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 287/553] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:08 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:09.646071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:09.646640 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:09.653738 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:09.654194 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:09.654972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:09.655090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:09.655497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:09.655645 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:09.663372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:09.663817 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:09.664604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:09.665077 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:09.863576 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:09.867693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:09.873225 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:09.874751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d1783348-f268-47e9-bfff-64497c3917ac tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.232507 Aug 03 18:55:09.875615 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 267/554] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:09 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:09.880569 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:09.881447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:09.887487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:09.889100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:09.890059 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:09.890297 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3624084f-c32d-4334-9af8-ca48cdcfa586 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.239219 Aug 03 18:55:09.891008 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:09.892142 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:09.892877 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:09.895352 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 288/555] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:09 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:10.102718 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:10.111585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c92f6ac9-4059-4b53-992d-e8016c5952be tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.234766 Aug 03 18:55:10.112150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 268/556] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:09 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:10.346237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-57538985-2f98-4831-a0e4-8dbaaac2554b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:10.352550 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-57538985-2f98-4831-a0e4-8dbaaac2554b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:10.353027 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-57538985-2f98-4831-a0e4-8dbaaac2554b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:10.412608 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-57538985-2f98-4831-a0e4-8dbaaac2554b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Going to try to stop instance {{(pid=129369) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 18:55:10.456106 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-57538985-2f98-4831-a0e4-8dbaaac2554b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action" status: 202 len: 0 microversion: 2.1 time: 0.113552 Aug 03 18:55:10.456745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 289/557] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:55:10 2022] POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:55:10.465559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:10.466107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:10.472051 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:10.472554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:10.473327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:10.473770 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:10.601768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:10.611888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1927ca28-80fa-42a8-b6ba-5379a5a94c42 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.150896 Aug 03 18:55:10.612480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 269/558] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:10 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:10.898185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:10.898840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:10.905972 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:10.906422 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:10.907186 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:10.907619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:10.918404 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:10.919177 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:10.927093 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:10.927635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:10.928566 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:10.929098 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:11.113213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:11.120469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:11.121868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6578a39d-b6dc-4563-9693-d19bca50593c tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.228094 Aug 03 18:55:11.122655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 290/559] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:10 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:11.130769 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:11.132385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:11.132833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:11.133451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:11.133581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ed463b20-d715-4fe2-8042-07eab4a114b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.219383 Aug 03 18:55:11.138230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 270/560] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:10 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:11.140591 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:11.141044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:11.141808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:11.142246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:11.277150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:11.285523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-08d2517e-0359-4957-b78f-5cb0eccd36e9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.156314 Aug 03 18:55:11.286519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 291/561] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:11 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:11.339637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-2fb625b3-26ee-4034-91df-43631194758e req-d9a7dde9-b51d-43ed-b1b8-8191ee28ba96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba47ebe6-9d28-4b13-9821-c97069a6599c", "name": "network-vif-plugged", "status": "completed", "tag": "4741e5d0-0230-45b4-bb81-f5d66890db08"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:11.349050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-2fb625b3-26ee-4034-91df-43631194758e req-d9a7dde9-b51d-43ed-b1b8-8191ee28ba96 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:11.349500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-2fb625b3-26ee-4034-91df-43631194758e req-d9a7dde9-b51d-43ed-b1b8-8191ee28ba96 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:11.363092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-2fb625b3-26ee-4034-91df-43631194758e req-d9a7dde9-b51d-43ed-b1b8-8191ee28ba96 service nova] Creating event network-vif-plugged:4741e5d0-0230-45b4-bb81-f5d66890db08 for instance ba47ebe6-9d28-4b13-9821-c97069a6599c on hv-cinder-85164 Aug 03 18:55:11.368018 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-2fb625b3-26ee-4034-91df-43631194758e req-d9a7dde9-b51d-43ed-b1b8-8191ee28ba96 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032892 Aug 03 18:55:11.368648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 271/562] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:11.632467 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:11.633080 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:11.640218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:11.640705 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:11.641469 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:11.641908 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:11.778756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:11.786876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8866c050-1a37-4e42-9e5c-aa9a752d4fe5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.158336 Aug 03 18:55:11.787443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 292/563] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:11 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:12.144162 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:12.144926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:12.152252 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.152741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.153532 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.153974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.157745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:12.158542 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:12.165496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.165496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.167524 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.167959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.375557 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:12.378788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:12.383611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d3632297-4c41-4070-98f0-e6cd315d3438 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.244145 Aug 03 18:55:12.384198 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 272/564] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:12 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:12.387674 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:12.389210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:12.390378 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-50dc18d9-29f0-42b5-8017-796e2cdd1a30 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.236545 Aug 03 18:55:12.390834 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:12.391248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 293/565] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:12 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:12.391445 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:12.397571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.398019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.398770 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.399198 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.531869 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:12.539493 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8adec8cf-f2c5-4d6e-a3d5-f5d7a4ea53c4 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1359 microversion: 2.1 time: 0.152504 Aug 03 18:55:12.540057 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 273/566] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:12 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:12.809063 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:12.809601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:12.816094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.816576 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.817342 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:12.817783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:12.951484 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:12.959383 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f371e2aa-6d73-4331-aea6-51ee1a9e00b2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.155071 Aug 03 18:55:12.959949 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 294/567] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:12 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:13.406925 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:13.407670 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:13.413458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:13.414062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.414519 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.415483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.416619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:13.417232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.423147 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.423672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.425285 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.425925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.625499 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:13.628562 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:13.633385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-296a6089-10c8-495a-9d61-a7c7856bc9d0 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.230311 Aug 03 18:55:13.633966 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 274/568] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:13 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:13.638664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:13.639234 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:13.639369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:13.640926 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:13.642199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ba3f5969-f523-4c8a-b3c2-9e60973f48ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.232791 Aug 03 18:55:13.642846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 295/569] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:13 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:13.645560 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.646016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.646786 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.647224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.778878 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:13.786293 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d9608e2e-1c5f-4376-8446-5638e64795b6 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1549 microversion: 2.1 time: 0.151286 Aug 03 18:55:13.786798 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 275/570] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:13 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:13.806711 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:13.807314 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:13.813835 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.814276 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.815022 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.815447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.961621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:13.969904 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d09c1d5b-2492-4e28-8a12-14e94898e04b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1549 microversion: 2.1 time: 0.167353 Aug 03 18:55:13.970462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 296/571] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:13 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:13.981028 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:13.981650 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:13.988101 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.988608 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.989052 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:13.989393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:13.989833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:13.993884 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:13.994701 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Searching by: {'deleted': False, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276'} {{(pid=129369) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 18:55:14.001485 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.001939 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.002985 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.003417 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.093383 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.multi_cell_list [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129369) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 18:55:14.174307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:14.204115 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e3251442-fb8d-4448-9782-fb28f6a9089e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.218611 Aug 03 18:55:14.204738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 297/572] 10.222.0.69 () {58 vars in 1125 bytes} [Wed Aug 3 18:55:13 2022] GET /compute/v2.1/servers => generated 343 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:14.216827 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:14.217680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:14.223907 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.224382 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.225149 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.225586 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.289064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:14.298108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-edf8ffdf-d5ea-4620-8d1d-9c3e60e89b39 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.321163 Aug 03 18:55:14.298683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 276/573] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:13 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:14.424642 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:14.432556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cec0427d-6b06-4afe-bce8-a0f100b8ccde tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1549 microversion: 2.1 time: 0.220658 Aug 03 18:55:14.433134 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 298/574] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:14 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1549 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:14.657407 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:14.658028 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:14.664807 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.665272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.666083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.666451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:14.666982 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.667458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:14.673816 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.674304 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.675082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:14.675523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:14.892627 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:14.899528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-aa75e618-f506-4a69-b0d5-84f88975f5bc tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1318 microversion: 2.1 time: 0.247512 Aug 03 18:55:14.901218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 277/575] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:14 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:14.928682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:14.939031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:14.940562 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:14.941885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b538282d-fd28-4bce-a0fe-961ef5e6e001 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.279723 Aug 03 18:55:14.942615 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 299/576] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:14 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:15.319108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:15.319726 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:15.326382 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:15.326833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:15.327597 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:15.328044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:15.461272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:15.470137 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2a186774-09ae-47cf-82a8-07afbcd4c3b6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.154937 Aug 03 18:55:15.470702 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 278/577] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:15 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:15.921355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:15.921968 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:15.928559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:15.929013 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:15.929809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:15.930247 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:15.965951 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:15.967208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:15.973605 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:15.974061 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:15.974831 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:15.975269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:16.122363 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:16.129950 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-106cc73d-01f0-4abe-b1c9-a182c9ea035e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1506 microversion: 2.1 time: 0.212501 Aug 03 18:55:16.130515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 300/578] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:15 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:16.147843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:16.150426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5b3d223f-acea-41bc-95d9-38deada12f4d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9363347-80ad-4395-be36-6ee5a7fa56ef", "device": "/dev/sdb"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:16.152877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5b3d223f-acea-41bc-95d9-38deada12f4d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:16.155900 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:16.157428 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:16.158568 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-24b677ba-3354-472d-8e04-2ba52276d78e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.197067 Aug 03 18:55:16.158828 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b3d223f-acea-41bc-95d9-38deada12f4d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:16.159124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 279/579] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:15 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:16.159350 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b3d223f-acea-41bc-95d9-38deada12f4d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:16.160194 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b3d223f-acea-41bc-95d9-38deada12f4d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:16.160666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b3d223f-acea-41bc-95d9-38deada12f4d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:16.420139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5b3d223f-acea-41bc-95d9-38deada12f4d tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "POST /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273432 Aug 03 18:55:16.420860 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 301/580] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 18:55:16 2022] POST /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:55:16.491189 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:16.491895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:16.498517 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:16.499046 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:16.500113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:16.500561 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:16.636988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:16.645258 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ff6ad9ef-9dd4-4b84-b303-2d17ab6860e4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.157812 Aug 03 18:55:16.645838 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 280/581] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:16 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:17.069705 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fd9c3001-fb44-4ffb-987e-3e1ab58ff367 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c97bc8d-809d-44b9-9163-6d9e5ceb5b15"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:17.072721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fd9c3001-fb44-4ffb-987e-3e1ab58ff367 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:17.078958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd9c3001-fb44-4ffb-987e-3e1ab58ff367 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:17.079415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd9c3001-fb44-4ffb-987e-3e1ab58ff367 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:17.080188 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd9c3001-fb44-4ffb-987e-3e1ab58ff367 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:17.080652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd9c3001-fb44-4ffb-987e-3e1ab58ff367 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:17.182972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:17.183749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:17.191373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:17.192050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:17.192876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:17.193533 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:17.362890 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:17.373070 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:17.374983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:17.376234 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6f9e8c18-7709-491b-a77e-821bdfc765a1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1744 microversion: 2.20 time: 0.198286 Aug 03 18:55:17.376822 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 281/582] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:17 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1744 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:17.380731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fd9c3001-fb44-4ffb-987e-3e1ab58ff367 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315700 Aug 03 18:55:17.386955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 302/583] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 18:55:17 2022] POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:17.668074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:17.668824 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:17.675096 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:17.675547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:17.676347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:17.676791 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:17.813002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:17.820983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9d3e7f21-0e3c-422b-8a16-abab4c1e0fdc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.157719 Aug 03 18:55:17.821560 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 282/584] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:17 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:18.404210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:18.404884 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:18.411637 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:18.412086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:18.412888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:18.413335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:18.547830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:18.556451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:18.558670 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:18.559854 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7379511c-1048-4783-8274-3e408ff3136d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1744 microversion: 2.20 time: 0.160010 Aug 03 18:55:18.560450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 303/585] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:18 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:18.843539 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:18.844089 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:18.850016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:18.850465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:18.851220 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:18.851665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:18.986054 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:18.995635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-297f0d1b-3ed3-47d9-a61f-f4f77f942ae8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.156574 Aug 03 18:55:18.996793 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 283/586] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:18 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:19.362324 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-31a7fbeb-4ebd-4ee7-bb24-2add6a0be962 req-c6f08ac8-ceff-4f54-97dc-e19511c73b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75afca33-3ec7-4c03-9d25-a247fc1e47bd", "name": "network-vif-plugged", "status": "completed", "tag": "1407aa85-6899-475c-a3c7-c06872937b88"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:19.372575 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-31a7fbeb-4ebd-4ee7-bb24-2add6a0be962 req-c6f08ac8-ceff-4f54-97dc-e19511c73b6c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:19.373027 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-31a7fbeb-4ebd-4ee7-bb24-2add6a0be962 req-c6f08ac8-ceff-4f54-97dc-e19511c73b6c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:19.385161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-31a7fbeb-4ebd-4ee7-bb24-2add6a0be962 req-c6f08ac8-ceff-4f54-97dc-e19511c73b6c service nova] Creating event network-vif-plugged:1407aa85-6899-475c-a3c7-c06872937b88 for instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd on hv-cinder-85164 Aug 03 18:55:19.390028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-31a7fbeb-4ebd-4ee7-bb24-2add6a0be962 req-c6f08ac8-ceff-4f54-97dc-e19511c73b6c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032380 Aug 03 18:55:19.390905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 304/587] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:19.582672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:19.583309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:19.589668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:19.590122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:19.590887 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:19.591329 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:19.721308 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:19.729672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:19.731218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:19.732400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1262a2ca-1495-47f5-9033-109ae12ecf2b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1744 microversion: 2.20 time: 0.153625 Aug 03 18:55:19.732960 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 284/588] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:19 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:20.023454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:20.024171 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:20.030630 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:20.031113 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:20.031884 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:20.032347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:20.412556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:20.421161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fcc88e05-4582-4daf-85c0-518f2cedd846 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.402437 Aug 03 18:55:20.421737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 305/589] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:20 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:20.755971 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:20.756629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:20.764431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:20.764892 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:20.765673 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:20.766141 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:20.770487 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:20.895140 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:20.903504 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:20.905067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:20.906212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4e0c6709-cd75-4831-97d8-9d60aa398983 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1744 microversion: 2.20 time: 0.154436 Aug 03 18:55:20.906775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 285/590] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:20 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:21.442294 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:21.442907 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:21.450550 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:21.450989 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:21.451751 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:21.452181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:21.583693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:21.592139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5bf8d7b5-8c41-4efd-bdbf-d069e3259b89 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1723 microversion: 2.1 time: 0.153719 Aug 03 18:55:21.592734 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 306/591] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:21 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:21.934177 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:21.934177 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:21.939408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:21.939862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:21.940702 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:21.941144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:22.074429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:22.082514 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:22.084635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:22.085797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0745dc4e-c496-4c5e-9468-09517b9b11a7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1744 microversion: 2.20 time: 0.159817 Aug 03 18:55:22.086354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 286/592] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:21 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:22.615935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:22.616500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:22.623769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:22.624223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:22.625014 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:22.625453 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:22.760052 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:22.767862 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b9fab152-316a-4548-9439-d940b55beb26 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1700 microversion: 2.1 time: 0.155881 Aug 03 18:55:22.768449 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 307/593] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:22 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:22.788275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-acec6379-0dbf-4b02-aaf9-c8e5cb5e581a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:22.798424 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-acec6379-0dbf-4b02-aaf9-c8e5cb5e581a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:22.798872 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-acec6379-0dbf-4b02-aaf9-c8e5cb5e581a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:22.860326 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-acec6379-0dbf-4b02-aaf9-c8e5cb5e581a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Going to try to start instance {{(pid=129368) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 18:55:22.903648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-acec6379-0dbf-4b02-aaf9-c8e5cb5e581a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action" status: 202 len: 0 microversion: 2.1 time: 0.119078 Aug 03 18:55:22.904161 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 287/594] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:55:22 2022] POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:55:22.912358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:22.912972 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:22.920039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:22.920518 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:22.921300 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:22.921785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:23.053929 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:23.062517 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-16145204-5db4-497e-a0c5-a73242e52538 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1709 microversion: 2.1 time: 0.153968 Aug 03 18:55:23.063086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 308/595] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:22 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:23.109968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:23.110684 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:23.117268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:23.117719 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:23.118482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:23.118945 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:23.258354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:23.267000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:23.268692 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:23.269944 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-12ed2c2b-c458-41c8-82c2-a8df0494f268 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1744 microversion: 2.20 time: 0.164503 Aug 03 18:55:23.270568 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 288/596] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:23 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:24.083259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:24.083861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:24.086281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:24.091965 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:24.092451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:24.093215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:24.093645 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:24.271718 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:24.280008 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9b81d53b-d454-49a6-931f-9606cbbe4d79 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1709 microversion: 2.1 time: 0.200546 Aug 03 18:55:24.280622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 309/597] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:24 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1709 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:24.293810 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:24.294433 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:24.301042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:24.301476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:24.302254 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:24.302694 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:24.505129 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:24.513894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:24.515391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:24.516696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d5f0df40-7d31-4386-a827-5a8c127f5d19 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1744 microversion: 2.20 time: 0.227649 Aug 03 18:55:24.517251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 289/598] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:24 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1744 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:25.302622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:25.303191 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:25.312408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:25.312858 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:25.313902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:25.314335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:25.539688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:25.542357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:25.548030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=77 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:25.550081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:25.550847 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:25.552034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:25.552740 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:25.553841 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:25.568720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-03e9c86a-4cfc-41e4-8c4b-5341d8fe2e8b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1709 microversion: 2.1 time: 0.268317 Aug 03 18:55:25.569636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 310/599] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:25 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1709 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:25.703743 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:25.711957 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:25.714227 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:25.715426 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1c7ba839-3404-4186-9488-db41c4ffa36c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.180430 Aug 03 18:55:25.716461 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 290/600] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:25 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:26.591013 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:26.591666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:26.594102 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=83 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:26.599942 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:26.600428 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:26.601198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:26.601635 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:26.741302 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:26.742842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:26.751502 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:26.752741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:26.753792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:26.755107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:26.765465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:26.775001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-526744b1-9acb-41ea-8ddf-ad7abd27c0f4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1709 microversion: 2.1 time: 0.188089 Aug 03 18:55:26.775876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 311/601] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:26 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1709 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:26.933372 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:26.944538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:26.946440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:26.949108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bb81d3e7-e5f4-453e-98ea-a919f1cddc91 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.213417 Aug 03 18:55:26.960861 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 291/602] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:26 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:27.797299 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:27.798749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:27.805773 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:27.806239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:27.807539 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:27.807976 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:27.828499 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:27.974755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:27.975586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:27.984157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:27.984835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:27.985678 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:27.986178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:27.987255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:27.997847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-76e0204c-185a-4a41-8255-04a927e6b5c5 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1709 microversion: 2.1 time: 0.202944 Aug 03 18:55:28.022728 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 312/603] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:27 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:28.147644 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:28.158326 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:28.160275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:28.161732 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a7c5004e-4cd6-4b09-a2de-19e6f2f3df40 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.191148 Aug 03 18:55:28.162454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 292/604] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:27 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:29.020414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:29.021912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:29.029062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:29.029604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:29.030467 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:29.030981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:29.188851 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:29.190284 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:29.196780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:29.198169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:29.199372 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:29.200092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:29.203366 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:29.212625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-461ea21e-53b9-46ae-9541-5f311c041779 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1709 microversion: 2.1 time: 0.196005 Aug 03 18:55:29.213980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 313/605] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:29 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1709 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:29.368190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:29.378411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:29.380026 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:29.381218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7ad29af1-5a99-49c0-af83-0b11ad7e2b4e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.197102 Aug 03 18:55:29.381992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 293/606] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:29 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:30.380321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:30.381196 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:30.388699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:30.389243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:30.390237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:30.390739 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:30.406180 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:30.407578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:30.417917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:30.419008 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:30.420617 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:30.421612 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:30.600255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:30.616084 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6a49a02f-3a8e-4cd7-a6a1-771db7090d27 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1709 microversion: 2.1 time: 0.384092 Aug 03 18:55:30.631123 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 314/607] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:30 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1709 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:30.648615 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:30.667758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:30.669652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:30.671549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-818d3143-c8e5-4096-a654-c4abeade6869 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.268778 Aug 03 18:55:30.685223 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 294/608] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:30 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:55:31.644270 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:31.645339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:31.656418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:31.658753 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:31.660206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:31.661129 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:31.701286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:31.702810 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:31.711235 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:31.711782 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:31.712916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:31.713373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:31.900916 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:31.926152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7fb4b5b9-f8c8-494b-82f4-f515172dfde3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1713 microversion: 2.1 time: 0.287391 Aug 03 18:55:31.926856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 315/609] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:31 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1713 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:31.972549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:31.983490 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:31.985157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:31.986368 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cac450e1-6b1f-4cb3-b395-6b44d76ad95a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.292888 Aug 03 18:55:31.986954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 295/610] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:31 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:33.012338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:33.012999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:33.020058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:33.020779 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:33.021770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:33.022251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:33.289058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:33.299636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:33.301152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:33.302797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e2032788-4427-4094-9d33-1a872331751d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.295808 Aug 03 18:55:33.318425 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 316/611] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:33 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:34.330187 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:34.331500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:34.338969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:34.340150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:34.341096 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:34.341574 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:34.490710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:34.504278 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:34.504278 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:34.504278 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b7561c94-41c7-478d-be8f-c6fb38a1201e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.180488 Aug 03 18:55:34.504749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 296/612] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:34 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:35.529068 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:35.529682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:35.536192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:35.536680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:35.537452 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:35.537894 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:35.673332 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:35.682313 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:35.683924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:35.685133 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-024af9c3-50c0-4fbd-9b89-11cecde73d68 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.160342 Aug 03 18:55:35.685691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 317/613] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:35 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:36.708829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:36.709473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:36.716232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:36.716718 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:36.717486 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:36.717925 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:36.847909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:36.856136 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:36.857698 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:36.858853 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-78854594-6198-4663-8031-6b9ccd98ec38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.153927 Aug 03 18:55:36.859410 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 297/614] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:36 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:37.885819 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:37.886836 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:37.893882 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:37.894335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:37.895108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:37.895551 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:38.023715 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:38.031860 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:38.033538 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:38.034695 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5fb310b2-627b-40bf-ad61-924b0af07025 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.156186 Aug 03 18:55:38.035259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 318/615] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:37 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:39.058193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:39.058734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:39.065080 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:39.065526 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:39.066289 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:39.066734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:39.207677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:39.216808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:39.219395 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:39.220565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-dc2853cc-3819-4dfe-9ec2-3eacf751a500 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1739 microversion: 2.20 time: 0.166576 Aug 03 18:55:39.221120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 298/616] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:39 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:40.244242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:40.244913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:40.252068 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:40.252812 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:40.253580 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:40.254012 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:40.393655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:40.402191 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:40.403743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:40.404936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-651d85d9-08f6-44dd-bfe6-8462c29c0780 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1721 microversion: 2.20 time: 0.164829 Aug 03 18:55:40.405495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 319/617] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:40 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:41.403003 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-7ffeae1d-8176-4d29-a3f9-b308300af362 req-dd62a89f-dcf2-4c00-8ace-ec15e51210e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75afca33-3ec7-4c03-9d25-a247fc1e47bd", "name": "network-vif-unplugged", "status": "completed", "tag": "1407aa85-6899-475c-a3c7-c06872937b88"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:41.413347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-7ffeae1d-8176-4d29-a3f9-b308300af362 req-dd62a89f-dcf2-4c00-8ace-ec15e51210e0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:41.413837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-7ffeae1d-8176-4d29-a3f9-b308300af362 req-dd62a89f-dcf2-4c00-8ace-ec15e51210e0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:41.425913 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-7ffeae1d-8176-4d29-a3f9-b308300af362 req-dd62a89f-dcf2-4c00-8ace-ec15e51210e0 service nova] Creating event network-vif-unplugged:1407aa85-6899-475c-a3c7-c06872937b88 for instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd on hv-cinder-85164 Aug 03 18:55:41.427886 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:41.429634 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:41.430878 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-7ffeae1d-8176-4d29-a3f9-b308300af362 req-dd62a89f-dcf2-4c00-8ace-ec15e51210e0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032048 Aug 03 18:55:41.431671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 299/618] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:41.436362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:41.436885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:41.437831 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:41.438330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:41.573923 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:41.581801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:41.583318 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:41.584493 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b0cfabe7-9631-49c3-b120-640439d32412 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1721 microversion: 2.20 time: 0.161364 Aug 03 18:55:41.585059 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 320/619] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:41 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:42.087452 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:42.088247 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:42.094376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:42.094825 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:42.095591 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:42.096053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:42.130696 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:42.131357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:42.138152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:42.138601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:42.139371 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:42.139808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:42.232548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:42.240401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-aabb25b0-3dee-48ae-9a42-36d8d9046c4e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1595 microversion: 2.1 time: 0.157074 Aug 03 18:55:42.241459 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 300/620] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:42 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:42.270360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lazy-loading 'services' on Instance uuid ba47ebe6-9d28-4b13-9821-c97069a6599c {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:55:42.390722 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4bc56bea-d334-4faa-9e5c-ea7662041b37 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c/os-volume_attachments/c9363347-80ad-4395-be36-6ee5a7fa56ef" status: 202 len: 0 microversion: 2.1 time: 0.263935 Aug 03 18:55:42.391279 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 321/621] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 18:55:42 2022] DELETE /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c/os-volume_attachments/c9363347-80ad-4395-be36-6ee5a7fa56ef => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 18:55:42.608064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:42.608773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:42.615183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:42.615632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:42.616427 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:42.616867 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:42.635844 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:42.753831 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:42.763002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:42.764905 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:42.766076 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ad07cbf9-bb07-4e50-aedb-4ac5a7fb5896 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1721 microversion: 2.20 time: 0.162811 Aug 03 18:55:42.766691 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 301/622] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:42 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:43.789886 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:43.790787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:43.796988 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:43.797444 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:43.798219 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:43.798660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:43.963548 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:43.971865 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:43.973522 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:43.974756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d9f6f173-6ffc-4028-9bea-afc032a3f746 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1721 microversion: 2.20 time: 0.189575 Aug 03 18:55:43.975402 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 322/623] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:43 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:44.106300 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-e984c058-5f35-4da5-8f8d-38030688d5a5 req-375e6f24-f169-4d1d-863a-9270355ab697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e36937-1f1d-4b7a-ae8b-df0940da9613", "tag": "63b75436-6d6d-448e-9e4b-b87c4d33b454"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:44.117590 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-e984c058-5f35-4da5-8f8d-38030688d5a5 req-375e6f24-f169-4d1d-863a-9270355ab697 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:44.119250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-e984c058-5f35-4da5-8f8d-38030688d5a5 req-375e6f24-f169-4d1d-863a-9270355ab697 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:44.135812 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-e984c058-5f35-4da5-8f8d-38030688d5a5 req-375e6f24-f169-4d1d-863a-9270355ab697 service nova] Creating event network-changed:63b75436-6d6d-448e-9e4b-b87c4d33b454 for instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 on hv-cinder-85164 Aug 03 18:55:44.142654 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-e984c058-5f35-4da5-8f8d-38030688d5a5 req-375e6f24-f169-4d1d-863a-9270355ab697 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040105 Aug 03 18:55:44.143363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 302/624] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:44.630156 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:44.634082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:44.641347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:44.642666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:44.643954 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:44.644722 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:44.679302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:55:44.777844 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-815e6ffa-1d74-469f-b3d7-7ab66d6e6d7e tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 204 len: 0 microversion: 2.1 time: 0.152338 Aug 03 18:55:44.778855 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 323/625] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:55:44 2022] DELETE /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:55:44.788233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:44.789366 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:44.797759 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:44.798775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:44.799721 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:44.800316 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.001002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:45.001764 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:45.006600 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:45.017652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6c2083e5-ef4a-47bf-9aaa-d8fea4e95160 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1512 microversion: 2.1 time: 0.234214 Aug 03 18:55:45.018523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 303/626] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:44 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:45.028478 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.028478 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.028478 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.028478 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.212570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:45.223072 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:45.225126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:45.226747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3a1a2db1-8421-4edc-bd34-6f3ecdd9eabd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1664 microversion: 2.20 time: 0.231105 Aug 03 18:55:45.228634 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 324/627] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:44 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1664 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:45.259399 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-45ecbfec-136f-4d35-a58e-ca7f6482936b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03f109b1-0350-4320-b4ba-f45692a3a21e"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:45.262797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-45ecbfec-136f-4d35-a58e-ca7f6482936b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:45.273423 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-45ecbfec-136f-4d35-a58e-ca7f6482936b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.274036 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-45ecbfec-136f-4d35-a58e-ca7f6482936b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.275211 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-45ecbfec-136f-4d35-a58e-ca7f6482936b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.276115 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-45ecbfec-136f-4d35-a58e-ca7f6482936b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.378787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2035214698"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:45.379527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:45.387251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.387705 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.388508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.388939 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.526942 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.network.security_group_api [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Adding security group 60ba659f-87a2-40d5-9c54-b7b0e421076c to port 63b75436-6d6d-448e-9e4b-b87c4d33b454 Aug 03 18:55:45.606838 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-45ecbfec-136f-4d35-a58e-ca7f6482936b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353064 Aug 03 18:55:45.612678 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 304/628] 10.222.0.69 () {62 vars in 1364 bytes} [Wed Aug 3 18:55:45 2022] POST /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:55:45.732894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:45.733634 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:45.740456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.740914 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.741686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.742130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.833663 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129368) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 18:55:45.873652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-798d80e1-7fad-45b0-aee5-a188fbe3673e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/action" status: 202 len: 0 microversion: 2.1 time: 0.499690 Aug 03 18:55:45.874377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 325/629] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:55:45 2022] POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:55:45.882899 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:45.883709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:45.891084 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.891604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.892529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:45.893042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:45.920938 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f46f6374-3ef2-495a-aacf-cb897ede486e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/action" status: 202 len: 0 microversion: 2.20 time: 0.183836 Aug 03 18:55:45.921829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 305/630] 10.222.0.69 () {62 vars in 1319 bytes} [Wed Aug 3 18:55:45 2022] POST /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 18:55:46.032244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-342d5dea-85b3-4cba-9c5d-24c356d3e981 req-040addb0-7b04-4af3-acb9-546fc2526552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e36937-1f1d-4b7a-ae8b-df0940da9613", "tag": "63b75436-6d6d-448e-9e4b-b87c4d33b454"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:46.048207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-342d5dea-85b3-4cba-9c5d-24c356d3e981 req-040addb0-7b04-4af3-acb9-546fc2526552 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:46.048860 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-342d5dea-85b3-4cba-9c5d-24c356d3e981 req-040addb0-7b04-4af3-acb9-546fc2526552 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:46.074214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-342d5dea-85b3-4cba-9c5d-24c356d3e981 req-040addb0-7b04-4af3-acb9-546fc2526552 service nova] Creating event network-changed:63b75436-6d6d-448e-9e4b-b87c4d33b454 for instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 on hv-cinder-85164 Aug 03 18:55:46.080584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-342d5dea-85b3-4cba-9c5d-24c356d3e981 req-040addb0-7b04-4af3-acb9-546fc2526552 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157201 Aug 03 18:55:46.081610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 306/631] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:55:46.086773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:46.088400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:46.095727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:46.096189 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:46.096996 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:46.097445 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:46.099224 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:46.122100 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4baaa74c-d246-4d58-a9f6-86f2b5c1c018 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1642 microversion: 2.1 time: 0.242836 Aug 03 18:55:46.126065 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 326/632] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:45 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1642 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:46.132656 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:46.142660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:46.149284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:46.149957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:46.150958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:46.151609 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:46.179930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:46.321027 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:46.335638 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:46.338274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:46.339813 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-145d6be5-fd0a-4bcb-b40f-97de1e56e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1750 microversion: 2.20 time: 0.256972 Aug 03 18:55:46.341193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 307/633] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:46 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1750 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:46.346993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:46.355310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6fb6f048-3896-47df-bf68-fa4767b51085 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1512 microversion: 2.1 time: 0.228196 Aug 03 18:55:46.357223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 327/634] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:46 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:47.362905 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:47.363496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:47.370731 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:47.371176 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:47.371965 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:47.372424 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:47.378625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:47.379239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:47.386497 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:47.386944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:47.387713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:47.388147 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:47.606881 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:47.616702 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:47.618930 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:47.620124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-11e4b415-1fd2-4a4f-b51d-8b4948338384 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1752 microversion: 2.20 time: 0.261057 Aug 03 18:55:47.620719 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 308/635] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:47 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1752 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:47.660203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:47.668464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-14620e84-34d0-4757-86d2-ad51b8386f7b tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1512 microversion: 2.1 time: 0.293947 Aug 03 18:55:47.682801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 328/636] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:47 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:55:48.013009 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-21709839-e677-4f72-82f4-cc58a24c10dd req-a5e8f109-1bfe-40ad-909c-53fe300bd1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba47ebe6-9d28-4b13-9821-c97069a6599c", "name": "network-vif-deleted", "tag": "4741e5d0-0230-45b4-bb81-f5d66890db08"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:55:48.022747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-21709839-e677-4f72-82f4-cc58a24c10dd req-a5e8f109-1bfe-40ad-909c-53fe300bd1c2 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:48.023196 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-21709839-e677-4f72-82f4-cc58a24c10dd req-a5e8f109-1bfe-40ad-909c-53fe300bd1c2 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:48.034876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-21709839-e677-4f72-82f4-cc58a24c10dd req-a5e8f109-1bfe-40ad-909c-53fe300bd1c2 service nova] Creating event network-vif-deleted:4741e5d0-0230-45b4-bb81-f5d66890db08 for instance ba47ebe6-9d28-4b13-9821-c97069a6599c on hv-cinder-85164 Aug 03 18:55:48.039958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-21709839-e677-4f72-82f4-cc58a24c10dd req-a5e8f109-1bfe-40ad-909c-53fe300bd1c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030686 Aug 03 18:55:48.041189 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 309/637] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:55:48.647215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:48.648520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:48.657593 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:48.658166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:48.659294 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:48.659735 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:48.693368 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:48.694919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:48.706125 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:48.706579 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:48.707360 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:48.707817 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:48.761885 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:48.762500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:48.763494 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lazy-loading 'fault' on Instance uuid ba47ebe6-9d28-4b13-9821-c97069a6599c {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:55:48.819142 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe100dded4484be3981b33384f4c68b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '653198c47b6a4f68b5ac4932b02b95d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:48.827131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7be2d187-3acf-49ab-a935-dc48d5be6daa tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 200 len: 1308 microversion: 2.1 time: 0.138143 Aug 03 18:55:48.827705 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 310/638] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:48 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:55:48.862936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:48.873560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:48.875067 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:48.876480 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-97290c0a-f0c4-4d5c-b06b-c7bd8897810c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1752 microversion: 2.20 time: 0.234558 Aug 03 18:55:48.877066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 329/639] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:48 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:49.848351 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:49.848991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] [instance: ba47ebe6-9d28-4b13-9821-c97069a6599c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:49.855785 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:49.856228 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:49.857021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:49.857571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:49.871045 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] HTTP exception thrown: Instance ba47ebe6-9d28-4b13-9821-c97069a6599c could not be found. Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Request method failure captured: Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c HTTP/1.1 Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sPsIT9059_WfTOsZM2HSf_TLoBBVC7OchV6mjoowNC0mfzcSC_fmNs7r1cm59Q8IwDXWWFBZm_xt23Yygffc0PsN11ySD-9Q1LSGT-st60PdoCxvEM0P9h6FSCdVtJXslkRKLQ_au09scRHcyn4f0FbYyXIUcR6zVy_ZCzJxgJs2_s Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 653198c47b6a4f68b5ac4932b02b95d0 Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2127092173 Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:55:49.872747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/653198c47b6a4f68b5ac4932b02b95d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-VolumesSnapshotTestJSON-2127092173 Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 653198c47b6a4f68b5ac4932b02b95d0 Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2127092173 Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-VolumesSnapshotTestJSON-2127092173-project Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: fe100dded4484be3981b33384f4c68b2 Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-VolumesSnapshotTestJSON-2127092173-project Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance ba47ebe6-9d28-4b13-9821-c97069a6599c could not be found. Aug 03 18:55:49.874297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'ba47ebe6-9d28-4b13-9821-c97069a6599c'} Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba47ebe6-9d28-4b13-9821-c97069a6599c could not be found. Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:55:49.875113 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba47ebe6-9d28-4b13-9821-c97069a6599c could not be found. Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba47ebe6-9d28-4b13-9821-c97069a6599c could not be found. Aug 03 18:55:49.876534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:55:49.877968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] Returning 404 to user: Instance ba47ebe6-9d28-4b13-9821-c97069a6599c could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:55:49.877968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d8b80339-86c3-41fa-ab1d-53e7e13fa0c5 tempest-VolumesSnapshotTestJSON-2127092173 tempest-VolumesSnapshotTestJSON-2127092173-project] 10.222.0.69 "GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c" status: 404 len: 111 microversion: 2.1 time: 0.029771 Aug 03 18:55:49.878484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 311/640] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:55:49 2022] GET /compute/v2.1/servers/ba47ebe6-9d28-4b13-9821-c97069a6599c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:55:49.899097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:49.900773 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:49.907894 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:49.908157 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:49.908973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:49.909597 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:50.100176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:50.110869 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:50.112614 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:50.113794 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a3c40a54-8658-4373-98c6-70f7134ee781 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.218695 Aug 03 18:55:50.125761 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 330/641] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:49 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:51.147604 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:51.149122 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:51.156957 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:51.157572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:51.158455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:51.159696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:51.305317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:51.314997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:51.316632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:51.317870 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b0a6d769-3e5a-4612-8500-b5347afc2989 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.174521 Aug 03 18:55:51.318707 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 312/642] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:51 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:52.341894 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:52.342611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:52.363283 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:52.363748 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:52.364565 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:52.365009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:52.505319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:52.515991 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:52.518034 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:52.519455 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-aca15855-ddd5-476a-9f88-64c24b9d2950 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.181465 Aug 03 18:55:52.533511 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 331/643] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:52 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:53.542739 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:53.543450 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:53.549809 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:53.550263 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:53.551030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:53.551470 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:53.687590 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:53.695952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:53.697660 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:53.698816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4f74fb68-7f25-4260-8cb6-5f00bcf5b257 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.160531 Aug 03 18:55:53.699379 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 313/644] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:53 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:54.720929 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:54.721532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:54.728682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:54.728846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:54.729493 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:54.729935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:54.860610 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:54.869565 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:54.871668 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:54.872871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e35a5cc2-eab1-41d3-8f40-9d097f2fc3ee tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.155907 Aug 03 18:55:54.873435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 332/645] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:54 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:55.896451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:55.897077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:55.899677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:55.906018 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:55.906474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:55.907250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:55.907692 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:56.044352 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:56.057527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:56.059949 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:56.061753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4c6a3152-f041-4869-aebf-3296449214ba tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.168981 Aug 03 18:55:56.072724 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 314/646] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:55 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:57.086603 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:57.087775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:57.090751 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:55:57.098742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:57.099464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:57.100502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:57.101136 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:57.250581 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:57.259866 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:57.261775 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:57.262931 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-00c4a874-19af-4e52-9a7f-0cc50d59a6e5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.180397 Aug 03 18:55:57.263640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 333/647] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:57 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:58.285243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:58.285844 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:58.293777 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:58.294219 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:58.294976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:58.295403 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:58.432814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:58.441193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:58.442784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:58.443938 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-409d90ef-ff8a-4970-a359-6f6e0dbac1ff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.162587 Aug 03 18:55:58.444538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 315/648] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:58 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:55:59.467108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:55:59.467718 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:55:59.474345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:59.474797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:59.475570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:55:59.476021 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:55:59.607271 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:59.616455 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:59.617973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:55:59.619880 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-37350eda-e20c-4ee9-b01e-7b75335d5617 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.156702 Aug 03 18:55:59.620483 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 334/649] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:55:59 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:00.642734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:00.643569 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:00.650673 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:00.651133 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:00.651919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:00.652430 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:00.783476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:00.786915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:00.793094 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:00.794691 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:00.795845 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0968052f-0795-4873-a8af-2ddff42ad498 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.157150 Aug 03 18:56:00.796431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 316/650] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:00 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:01.819169 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:01.819781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:01.826917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:01.827371 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:01.828120 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:01.828576 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:01.963811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:01.972123 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:01.973800 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:01.974947 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-317bc7a9-7e95-41dd-a781-ba50d9c022b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.159785 Aug 03 18:56:01.975523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 335/651] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:01 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:02.999229 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:03.000095 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:03.008316 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:03.009193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:03.010620 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:03.011058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:03.151492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:03.159959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:03.161488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:03.162641 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-60aeb887-cc99-48fc-8374-9a3993bb6f72 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.168709 Aug 03 18:56:03.163203 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 317/652] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:02 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:04.186008 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:04.186587 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:04.193180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:04.193636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:04.194401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:04.194840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:04.335765 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:04.348798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:04.350613 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:04.351969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-143c863d-d5c7-4141-b67a-65ddd70b325e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.170618 Aug 03 18:56:04.361559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 336/653] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:04 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:05.375876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:05.376790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:05.383043 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:05.383490 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:05.384781 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:05.385609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:05.519835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:05.529771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:05.532148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:05.533813 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-37fe4e1c-2eab-44f3-8591-85d0942899ed tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.161947 Aug 03 18:56:05.534626 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 318/654] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:05 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:06.559417 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:06.560328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:06.566667 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:06.567123 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:06.567895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:06.568369 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:06.700298 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:06.708663 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:06.710140 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:06.711316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-285bd775-aceb-46d3-ae88-eaa0d69fe494 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.156395 Aug 03 18:56:06.711871 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 337/655] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:06 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:07.735022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:07.735631 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:07.742117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:07.742684 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:07.743531 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:07.744024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:07.893903 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:07.903690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:07.905240 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:07.906406 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2685bfc2-0b78-4ec6-82cd-25de5fa955f0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.175523 Aug 03 18:56:07.906972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 319/656] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:07 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:08.929420 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:08.930243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:08.938087 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:08.938533 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:08.939299 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:08.939732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:09.082116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:09.091250 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:09.092771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:09.093921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9a3d0e91-5957-4e5b-9324-836c4782de52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.169238 Aug 03 18:56:09.094477 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 338/657] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:08 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:10.119863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:10.120699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:10.127677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:10.128118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:10.128915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:10.129344 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:10.266249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:10.274685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:10.276958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:10.278116 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7d015027-048b-483b-96e7-a9ba21c3e9d5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.162886 Aug 03 18:56:10.278672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 320/658] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:10 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:11.301255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:11.301856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:11.308468 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:11.308961 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:11.309732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:11.310169 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:11.442126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:11.451367 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:11.452928 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:11.454101 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-57ff7399-1065-4fc6-9b4b-9d2804781a35 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.156809 Aug 03 18:56:11.454674 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 339/659] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:11 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:12.477521 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:12.478542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:12.485349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:12.485828 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:12.486596 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:12.487041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:12.627567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:12.637480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:12.638999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:12.640163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c290e87f-6180-4b8c-b2e3-5edfa858d907 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.166858 Aug 03 18:56:12.640753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 321/660] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:12 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:13.663122 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:13.663741 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:13.670702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:13.671185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:13.671979 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:13.672497 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:13.803460 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:13.812154 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:13.813711 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:13.814873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b747bf02-0a65-4ade-bef2-2695205573b8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.155708 Aug 03 18:56:13.815438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 340/661] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:13 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:14.838576 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:14.839190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:14.845895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:14.846417 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:14.847207 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:14.847637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:14.981744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:14.990548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:14.992178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:14.993373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9b7eec0f-82ac-4a26-9e9a-16b3cfdd5c4f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.159442 Aug 03 18:56:14.994194 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 322/662] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:14 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:16.019372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:16.020028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:16.027514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:16.027976 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:16.028802 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:16.029243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:16.168654 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:16.177197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:16.179293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:16.179925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a2164daf-efbd-4a8a-b06d-9db82a59363d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.164783 Aug 03 18:56:16.180507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 341/663] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:16 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:17.203764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:17.204405 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:17.210420 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:17.210866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:17.211624 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:17.212100 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:17.352389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:17.361797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:17.363330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:17.364589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-83aa8330-b45d-4f78-a6c3-1a9107da1d4a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.164816 Aug 03 18:56:17.365153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 323/664] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:17 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:18.389176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:18.389805 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:18.396434 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:18.396921 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:18.397726 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:18.398177 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:18.401655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=89 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:18.539901 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:18.548677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:18.550222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:18.551388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f625d389-00b3-48d3-8b27-fc4048a9cde4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.166386 Aug 03 18:56:18.551955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 342/665] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:18 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:19.574570 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:19.575178 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:19.581594 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:19.582041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:19.582795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:19.583222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:19.717626 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:19.726251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:19.727826 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:19.729045 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b57f6516-3d7f-4fff-a035-1f3374612d9c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.158502 Aug 03 18:56:19.729611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 324/666] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:19 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:20.752563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:20.753197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:20.760597 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:20.761031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:20.761800 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:20.762242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:20.904164 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:20.913144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:20.914697 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:20.916218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7aa67c2b-f0f2-49c8-9e4f-44ee07f153df tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.167880 Aug 03 18:56:20.916869 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 343/667] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:20 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:21.940588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:21.941206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:21.948401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:21.948857 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:21.949631 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:21.950074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:22.088751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:22.098568 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:22.100451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:22.101814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-21157220-4c16-4bda-bf8f-92ffedaf2ece tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.165385 Aug 03 18:56:22.103038 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 325/668] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:21 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:23.125927 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:23.126509 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:23.133628 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:23.134611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:23.135379 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:23.135815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:23.264671 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:23.273142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:23.275161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:23.276463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3f0cd6ae-cf6c-4ca0-be87-241f221217ec tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.154420 Aug 03 18:56:23.277031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 344/669] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:23 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:23.940025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-322b667a-c07b-40bf-814b-486daafd93c2 req-7bb246f9-8ac6-4140-974e-dbbed5310153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75afca33-3ec7-4c03-9d25-a247fc1e47bd", "name": "network-vif-plugged", "status": "completed", "tag": "1407aa85-6899-475c-a3c7-c06872937b88"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:23.951748 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-322b667a-c07b-40bf-814b-486daafd93c2 req-7bb246f9-8ac6-4140-974e-dbbed5310153 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:23.952192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-322b667a-c07b-40bf-814b-486daafd93c2 req-7bb246f9-8ac6-4140-974e-dbbed5310153 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:23.963933 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-322b667a-c07b-40bf-814b-486daafd93c2 req-7bb246f9-8ac6-4140-974e-dbbed5310153 service nova] Creating event network-vif-plugged:1407aa85-6899-475c-a3c7-c06872937b88 for instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd on hv-cinder-85164 Aug 03 18:56:23.968894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-322b667a-c07b-40bf-814b-486daafd93c2 req-7bb246f9-8ac6-4140-974e-dbbed5310153 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240877 Aug 03 18:56:23.969470 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 326/670] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:24.300619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:24.301237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:24.308016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:24.308704 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:24.309289 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:24.309730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:24.442662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:24.452167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:24.453711 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:24.454874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-259b6140-dc40-444f-bca1-328c57b1e52e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.158281 Aug 03 18:56:24.455439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 345/671] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:24 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:25.480918 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:25.481601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:25.487704 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:25.488146 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:25.488927 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:25.489362 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:25.627495 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:25.636648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:25.638183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:25.639335 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f69f5033-689c-4000-a407-abe7bb51d071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.164723 Aug 03 18:56:25.639899 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 327/672] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:25 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:26.662746 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:26.663375 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:26.670741 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:26.671198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:26.671969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:26.672447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:26.801944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:26.811364 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:26.812884 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:26.814037 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-73e6f5ec-48aa-4758-b199-7f08957a36ae tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.155349 Aug 03 18:56:26.814596 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 346/673] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:26 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:27.837956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:27.838577 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:27.841058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=28 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:27.846074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:27.846522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:27.847723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:27.848163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:28.072318 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:28.082842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:28.084823 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:28.086163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ca8cf524-08bf-4876-a7b4-d5624584a8a5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1808 microversion: 2.20 time: 0.252689 Aug 03 18:56:28.087000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 328/674] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:27 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:29.111102 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:29.111719 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:29.114010 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=28 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:29.120731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:29.121183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:29.121946 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:29.122383 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:29.252333 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:29.261864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:29.263393 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:29.264604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2f68f01b-f0e8-4bc1-89a3-407c687f80b3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1795 microversion: 2.20 time: 0.157414 Aug 03 18:56:29.265173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 347/675] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:56:29 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:56:30.093919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7947883d-7f23-4a4c-9568-f2860755ac0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "547180e8-67be-49d5-97fb-42e6c06cb496"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:30.096386 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7947883d-7f23-4a4c-9568-f2860755ac0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:30.102385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7947883d-7f23-4a4c-9568-f2860755ac0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:30.102845 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7947883d-7f23-4a4c-9568-f2860755ac0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:30.104572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7947883d-7f23-4a4c-9568-f2860755ac0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:30.105021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7947883d-7f23-4a4c-9568-f2860755ac0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:30.383164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7947883d-7f23-4a4c-9568-f2860755ac0e tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398982 Aug 03 18:56:30.383761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 329/676] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 18:56:29 2022] POST /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:56:37.922055 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:37.924376 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:37.931199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:37.932190 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:37.932999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:37.933439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:37.956008 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lazy-loading 'flavor' on Instance uuid 7cc1c313-9332-403b-bbe5-63a6c2166815 {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:56:38.077847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-26b144fc-360b-4e17-a1e3-debdd3a59f27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/action" status: 200 len: 32 microversion: 2.1 time: 0.159714 Aug 03 18:56:38.078385 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 348/677] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:56:37 2022] POST /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 18:56:38.090458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:38.091172 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:38.098595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:38.099084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:38.099936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:38.100493 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:38.103943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:38.321418 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:38.330134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cf0fe17c-8a27-4536-ba85-81935c82c1b8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.245912 Aug 03 18:56:38.330618 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 330/678] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:38 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:39.353118 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:39.354541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:39.360810 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:39.361255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:39.362016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:39.362449 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:39.498255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:39.506386 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c0a6bdfd-66cb-4ea9-9ab3-fb27eb03e632 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.158004 Aug 03 18:56:39.506959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 349/679] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:39 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:40.527473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:40.528016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:40.534525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:40.534975 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:40.535740 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:40.536173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:40.665014 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:40.673604 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-dbb2e3f3-4dbe-44cb-9065-3a542307d2d8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.150524 Aug 03 18:56:40.674173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 331/680] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:40 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:41.695940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:41.696568 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:41.703534 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:41.703987 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:41.704868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:41.705313 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:41.840655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:41.849362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-767ff4b7-6241-4c56-910a-7e9472a26cf4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.157447 Aug 03 18:56:41.850120 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 350/681] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:41 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:42.871255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:42.871989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:42.878649 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:42.879105 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:42.879868 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:42.880333 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:43.013044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:43.020835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e6bfd8e4-23c3-4056-a3a6-24686068df27 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.154106 Aug 03 18:56:43.021507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 332/682] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:42 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:44.043399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:44.044042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:44.050607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:44.051053 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:44.051811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:44.052363 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:44.184432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:44.192273 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c9a8cbc0-2837-408f-9c7f-f213242e5d5c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.153456 Aug 03 18:56:44.192802 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 351/683] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:44 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:45.214603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:45.215335 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:45.221855 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:45.222304 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:45.223069 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:45.223507 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:45.357159 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:45.365006 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e6f87e83-024a-4984-97d0-64bdfdc71755 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.154706 Aug 03 18:56:45.365574 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 333/684] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:45 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:46.387724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:46.388374 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:46.394841 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:46.395299 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:46.396081 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:46.396566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:46.525008 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:46.533760 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-433c3a93-ea8e-4bb4-91a6-cdd921aa9666 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.150582 Aug 03 18:56:46.534333 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 352/685] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:46 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:47.555791 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:47.556542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:47.563093 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:47.563542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:47.564313 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:47.564762 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:47.700194 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:47.708388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bf90381a-676e-4998-91f0-77384e8cf892 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.156394 Aug 03 18:56:47.708968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 334/686] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:47 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:48.729578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:48.731278 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:48.737624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:48.738082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:48.738848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:48.739287 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:48.741937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:48.872167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:48.880325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9344d4a7-6098-49e7-b97d-2bfc4807dc70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.154659 Aug 03 18:56:48.880874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 353/687] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:48 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:49.902781 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:49.903397 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:49.909979 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:49.910430 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:49.911204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:49.911646 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:50.062096 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:50.070042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-698f4f0a-c4d7-4216-b23c-6ab77dd9edee tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.171758 Aug 03 18:56:50.070604 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 335/688] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:49 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:51.092228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:51.092904 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:51.099453 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:51.099903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:51.100708 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:51.101151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:51.230890 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:51.238821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a36f8c39-d1c0-47ec-846d-758d4e4f1747 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.150616 Aug 03 18:56:51.239395 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 354/689] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:51 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:52.260862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:52.262271 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:52.268714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:52.269169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:52.269935 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:52.270374 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:52.401552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:52.409608 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e6cac46a-fcff-4d7b-a542-826119803914 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1732 microversion: 2.1 time: 0.152591 Aug 03 18:56:52.410176 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 336/690] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:52 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:53.430893 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:53.432155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:53.439038 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.439537 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:53.440355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.440798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:53.571540 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:53.580020 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9cb27731-8589-4fcc-93ff-1951e5059046 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1712 microversion: 2.1 time: 0.152959 Aug 03 18:56:53.580636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 355/691] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:53 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:53.642686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:53.643219 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:53.649615 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.650071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:53.650835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.651277 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:53.732131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] HTTP exception thrown: Cannot 'detach_volume' instance 7cc1c313-9332-403b-bbe5-63a6c2166815 while it is in vm_state rescued Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Request method failure captured: Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments/547180e8-67be-49d5-97fb-42e6c06cb496 HTTP/1.1 Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNvll95s2JABXcKEHVk4FbLHf6AY01rjPFZb7Nx52UR3RxU4xxPzYx0vbmghA_JCPLuql4FzknWrFab_fMCoDQDUGDtTlqhU86sCalI4Gc9fkhX8_AyMiJER3bu2xysUFlZkf2p1YAAXNMbA5rgUo0ARE4ZuPEOzCnvsmmUzx2UILk Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:56:53.733802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: c6085ba9dff1480a8a1674e492e0c6c3 Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:56:53.735440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Cannot 'detach_volume' instance 7cc1c313-9332-403b-bbe5-63a6c2166815 while it is in vm_state rescued Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'server_id': '7cc1c313-9332-403b-bbe5-63a6c2166815', 'id': '547180e8-67be-49d5-97fb-42e6c06cb496'} Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7cc1c313-9332-403b-bbe5-63a6c2166815 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:56:53.736389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7cc1c313-9332-403b-bbe5-63a6c2166815 while it is in vm_state rescued Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7cc1c313-9332-403b-bbe5-63a6c2166815 while it is in vm_state rescued Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:56:53.737919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Returning 409 to user: Cannot 'detach_volume' instance 7cc1c313-9332-403b-bbe5-63a6c2166815 while it is in vm_state rescued {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:56:53.739297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-26d652dd-cb12-4825-b37f-90d1b7e6eca7 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments/547180e8-67be-49d5-97fb-42e6c06cb496" status: 409 len: 152 microversion: 2.1 time: 0.096621 Aug 03 18:56:53.739297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 337/692] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 18:56:53 2022] DELETE /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments/547180e8-67be-49d5-97fb-42e6c06cb496 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 18:56:53.744619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b93f1bb0-da54-42db-8956-a0ca2ca65be2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:53.745158 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b93f1bb0-da54-42db-8956-a0ca2ca65be2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:53.752028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b93f1bb0-da54-42db-8956-a0ca2ca65be2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.752523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b93f1bb0-da54-42db-8956-a0ca2ca65be2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:53.753290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b93f1bb0-da54-42db-8956-a0ca2ca65be2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.753727 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b93f1bb0-da54-42db-8956-a0ca2ca65be2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:53.820313 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b93f1bb0-da54-42db-8956-a0ca2ca65be2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "POST /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/action" status: 202 len: 0 microversion: 2.1 time: 0.079446 Aug 03 18:56:53.824601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 356/693] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:56:53 2022] POST /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:56:53.829659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:53.830278 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:53.836204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.836688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:53.837448 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:53.837906 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:54.010312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:54.019127 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e4df1d11-0663-40f0-9cae-ea0996eadc61 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1720 microversion: 2.1 time: 0.193205 Aug 03 18:56:54.019699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 338/694] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:53 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:55.041438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:55.042141 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:55.049034 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:55.049491 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:55.050253 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:55.050691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:55.185454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:55.193208 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-858cdcf7-2940-428e-adec-2aa5d8abf49c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1720 microversion: 2.1 time: 0.156534 Aug 03 18:56:55.193771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 357/695] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:55 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:56.215053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:56.215663 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:56.222185 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:56.222641 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:56.223413 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:56.223858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:56.357588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:56.365527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2982be32-906e-43a7-a0b3-8637e7fdd6d5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1720 microversion: 2.1 time: 0.154588 Aug 03 18:56:56.366092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 339/696] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:56 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:57.388029 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:57.388678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:57.395225 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:57.395706 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:57.396524 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:57.396964 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:57.531993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:57.539853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-242e4d6b-4418-496c-98bd-3411306a3297 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1720 microversion: 2.1 time: 0.156122 Aug 03 18:56:57.540440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 358/697] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:57 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:58.561848 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:58.562403 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:58.564764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=24 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:56:58.570211 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:58.570664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:58.571437 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:58.571878 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:58.704790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:56:58.712730 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7b8d183b-1811-4e1b-bd3f-4167dc763c2f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1726 microversion: 2.1 time: 0.154808 Aug 03 18:56:58.713288 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 340/698] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:56:58 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:56:58.734182 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0f7bdcff-beca-470a-8fcd-63f1f90fb27a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:56:58.734762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0f7bdcff-beca-470a-8fcd-63f1f90fb27a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:56:58.741698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0f7bdcff-beca-470a-8fcd-63f1f90fb27a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:58.742141 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0f7bdcff-beca-470a-8fcd-63f1f90fb27a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:58.742914 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0f7bdcff-beca-470a-8fcd-63f1f90fb27a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:58.743352 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0f7bdcff-beca-470a-8fcd-63f1f90fb27a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:58.821860 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0f7bdcff-beca-470a-8fcd-63f1f90fb27a tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091775 Aug 03 18:56:58.822458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 359/699] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 18:56:58 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:56:59.729858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-cc6abdd7-b603-40e7-a241-ce0db380e12f req-6650c3f6-80e3-4988-8a40-f6e97fbc5fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc1c313-9332-403b-bbe5-63a6c2166815", "tag": "f1ac9290-e7c9-4c16-a9e9-ca539d39ba80"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:56:59.740233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-cc6abdd7-b603-40e7-a241-ce0db380e12f req-6650c3f6-80e3-4988-8a40-f6e97fbc5fdd service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:56:59.740731 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-cc6abdd7-b603-40e7-a241-ce0db380e12f req-6650c3f6-80e3-4988-8a40-f6e97fbc5fdd service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:56:59.764116 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-cc6abdd7-b603-40e7-a241-ce0db380e12f req-6650c3f6-80e3-4988-8a40-f6e97fbc5fdd service nova] Creating event network-changed:f1ac9290-e7c9-4c16-a9e9-ca539d39ba80 for instance 7cc1c313-9332-403b-bbe5-63a6c2166815 on hv-cinder-85164 Aug 03 18:56:59.769377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-cc6abdd7-b603-40e7-a241-ce0db380e12f req-6650c3f6-80e3-4988-8a40-f6e97fbc5fdd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043238 Aug 03 18:56:59.769981 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 341/700] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:57:01.784835 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-758524ed-580e-450d-a933-3798cb8e7ab6 req-45870d8c-50be-47e9-91f3-9a08dc115f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc1c313-9332-403b-bbe5-63a6c2166815", "tag": "f1ac9290-e7c9-4c16-a9e9-ca539d39ba80"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:01.789663 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=26 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:01.802011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-758524ed-580e-450d-a933-3798cb8e7ab6 req-45870d8c-50be-47e9-91f3-9a08dc115f43 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:01.802489 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-758524ed-580e-450d-a933-3798cb8e7ab6 req-45870d8c-50be-47e9-91f3-9a08dc115f43 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:01.814959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-758524ed-580e-450d-a933-3798cb8e7ab6 req-45870d8c-50be-47e9-91f3-9a08dc115f43 service nova] Creating event network-changed:f1ac9290-e7c9-4c16-a9e9-ca539d39ba80 for instance 7cc1c313-9332-403b-bbe5-63a6c2166815 on hv-cinder-85164 Aug 03 18:57:01.820014 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-758524ed-580e-450d-a933-3798cb8e7ab6 req-45870d8c-50be-47e9-91f3-9a08dc115f43 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039307 Aug 03 18:57:01.820842 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 360/701] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:57:10.672395 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 18:57:10.673076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 18:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 18:57:16.504194 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=3 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:16.504952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=67 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:16.509684 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:16.510254 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:16.518026 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:16.518471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:16.519231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:16.519661 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:16.599238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lazy-loading 'services' on Instance uuid 800ff343-a07b-438f-9353-240b8ce592a9 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:57:16.675416 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ad901d80-fe2e-4bda-a4ff-673bfb4faeb8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-volume_attachments/07eaca3f-be37-4749-8b94-64d746b1a814" status: 202 len: 0 microversion: 2.1 time: 0.172530 Aug 03 18:57:16.676227 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 342/702] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 18:57:16 2022] DELETE /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-volume_attachments/07eaca3f-be37-4749-8b94-64d746b1a814 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:57:17.803227 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1a6b7a30-40f6-48f2-8943-340f844bf520 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:17.805624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:17.806255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:17.814797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a6b7a30-40f6-48f2-8943-340f844bf520 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:17.815416 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a6b7a30-40f6-48f2-8943-340f844bf520 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:17.843514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1a6b7a30-40f6-48f2-8943-340f844bf520 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Going to try to stop instance {{(pid=129369) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 18:57:17.886300 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1a6b7a30-40f6-48f2-8943-340f844bf520 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action" status: 202 len: 0 microversion: 2.1 time: 0.087212 Aug 03 18:57:17.886900 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 361/703] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:57:17 2022] POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:57:17.901106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:17.902366 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:17.912611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:17.913723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:17.914832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:17.915371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:18.054428 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:18.061979 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2571d1d1-0404-4027-ab98-42c11604584a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.169378 Aug 03 18:57:18.062547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 343/704] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:17 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:19.083180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:19.083889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:19.091728 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:19.092174 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:19.092973 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:19.093405 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:19.225168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:19.232786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6a40df74-d62a-4218-a161-93a6d6351bea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.153816 Aug 03 18:57:19.233354 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 362/705] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:19 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:20.254817 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:20.255651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:20.263313 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:20.263927 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:20.265078 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:20.265726 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:20.397908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:20.406141 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-799a3a0e-f6b6-4883-b51a-a4e0ea354b93 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.156426 Aug 03 18:57:20.406697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 344/706] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:20 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:21.429064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:21.429683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:21.436887 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:21.437341 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:21.438140 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:21.438577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:21.579771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:21.587193 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-980d27a7-bb07-42d5-8afc-7149486799d3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.162272 Aug 03 18:57:21.587762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 363/707] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:21 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:22.609962 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:22.610515 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:22.617004 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:22.617445 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:22.618559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:22.619057 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:22.749049 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:22.756735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-04ee6052-0f4c-49ad-9c5a-8818b9b07562 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.151453 Aug 03 18:57:22.757296 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 345/708] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:22 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:23.777795 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:23.778560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:23.785112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:23.785566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:23.786334 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:23.786773 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:23.920854 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:23.928330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9d83b8cc-866a-4b78-af1b-36ef17c7d557 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.154378 Aug 03 18:57:23.928889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 364/709] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:23 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:24.948676 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:24.949291 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:24.956579 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:24.957063 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:24.957799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:24.958223 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:25.088370 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:25.096605 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4cdf4826-959f-4db4-b5fe-a15480392df8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.151715 Aug 03 18:57:25.097166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 346/710] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:24 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:26.117376 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:26.118016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:26.125064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:26.125513 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:26.126266 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:26.127042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:26.258845 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:26.267508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-052731e3-552f-49ea-9296-1c355c387d31 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.153900 Aug 03 18:57:26.268070 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 365/711] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:26 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:27.288759 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:27.289371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:27.295979 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:27.296550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:27.298158 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:27.298598 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:27.336992 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-75454ba9-4047-4f15-8def-53de19000abf tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:27.339419 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-75454ba9-4047-4f15-8def-53de19000abf tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:27.346733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75454ba9-4047-4f15-8def-53de19000abf tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:27.347278 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75454ba9-4047-4f15-8def-53de19000abf tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:27.348062 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75454ba9-4047-4f15-8def-53de19000abf tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:27.348532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75454ba9-4047-4f15-8def-53de19000abf tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:27.425781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-75454ba9-4047-4f15-8def-53de19000abf tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/action" status: 202 len: 0 microversion: 2.1 time: 0.092418 Aug 03 18:57:27.429731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 366/712] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:57:27 2022] POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:57:27.435310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:27.435999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:27.439327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:27.447296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:27.447720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-216bc227-e360-43f2-a034-107dcdff46ab tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.162742 Aug 03 18:57:27.448407 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:27.449119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 347/713] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:27 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:27.449751 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:27.450380 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:27.681596 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:27.689863 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f233c145-2319-4798-a152-ebb42483f3c9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1753 microversion: 2.1 time: 0.258821 Aug 03 18:57:27.690430 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 367/714] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:27 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1753 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:28.469536 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:28.470691 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:28.477264 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:28.477708 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:28.478463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:28.478895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:28.612972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:28.621116 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1b896cc9-5742-46a5-b5f6-f90b0992228f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.155934 Aug 03 18:57:28.621686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 348/715] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:28 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:28.712040 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:28.712677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:28.719917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:28.720462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:28.721228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:28.721667 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:28.867042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:28.880559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-207abc82-d886-47ab-bff4-491488ad10b2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.172333 Aug 03 18:57:28.881134 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 368/716] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:28 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:29.643286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:29.643901 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:29.650347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:29.650799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:29.651561 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:29.652003 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:29.785358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:29.792922 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-afed5cd6-1764-4154-a433-7e850f49b95f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.154273 Aug 03 18:57:29.793485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 349/717] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:29 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:29.905675 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:29.906290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:29.912948 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:29.913402 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:29.914169 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:29.914616 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:30.060086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:30.068902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fdb4a5f1-3e1d-413e-9926-a9f51bc065d2 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.167128 Aug 03 18:57:30.069473 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 369/718] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:29 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:30.814690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:30.815358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:30.822027 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:30.822484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:30.823254 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:30.823690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:30.965484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:30.973584 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d60e8866-79ee-441e-a8e2-2ab5e5be7cb6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.163297 Aug 03 18:57:30.974231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 350/719] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:30 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:31.090578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:31.091126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:31.098290 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:31.098738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:31.099589 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:31.100557 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:31.416155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:31.424130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-00abba99-8f68-45f5-a08c-5b4b037c35a0 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.337612 Aug 03 18:57:31.424755 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 370/720] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:31 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:31.995301 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:31.995959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:32.003792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:32.004236 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:32.006022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:32.006461 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:32.138022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:32.145717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9fd8dc4d-805f-498e-9057-ac6336efcc62 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.154361 Aug 03 18:57:32.146280 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 351/721] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:31 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:32.445031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:32.445646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:32.452102 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:32.452602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:32.453365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:32.453806 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:32.599980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:32.607928 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ebd02000-6f96-45eb-9871-c4afd1247ff8 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.166781 Aug 03 18:57:32.608507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 371/722] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:32 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:33.166331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:33.166940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:33.174200 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:33.174649 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:33.175496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:33.175930 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:33.315015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:33.322545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a87fdb43-cc76-4991-8c1d-0da52668aef3 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1677 microversion: 2.1 time: 0.159997 Aug 03 18:57:33.323124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 352/723] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:33 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:33.630243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:33.630847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:33.637311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:33.637771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:33.638528 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:33.638954 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:33.779720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:33.788335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-41f3a8e6-97f8-4927-a1a6-a9952292b03d tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.162653 Aug 03 18:57:33.788905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 372/724] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:33 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:34.343223 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:34.343943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:34.350648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:34.351094 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:34.351859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:34.352309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:34.484637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:34.493048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d454adda-7b46-4b5d-a073-d5821185874e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1654 microversion: 2.1 time: 0.153960 Aug 03 18:57:34.493616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 353/725] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:34 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:34.519103 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-977dd84b-d44e-4d1c-b97d-270d3841420a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:34.525205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-977dd84b-d44e-4d1c-b97d-270d3841420a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:34.525660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-977dd84b-d44e-4d1c-b97d-270d3841420a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:34.547090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-977dd84b-d44e-4d1c-b97d-270d3841420a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Going to try to start instance {{(pid=129369) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 18:57:34.589632 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-977dd84b-d44e-4d1c-b97d-270d3841420a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action" status: 202 len: 0 microversion: 2.1 time: 0.074278 Aug 03 18:57:34.590261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 373/726] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:57:34 2022] POST /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:57:34.598581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:34.599198 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:34.605511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:34.605944 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:34.606865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:34.607331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:34.754392 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:34.762034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cae94473-c603-40e1-838f-56f4b6d6f9c4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1663 microversion: 2.1 time: 0.167444 Aug 03 18:57:34.762615 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 354/727] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:34 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:34.810541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:34.811161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:34.818586 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:34.819032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:34.819797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:34.820226 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:34.839532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:35.285288 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:35.293312 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-19543e4f-9b70-4f39-99bb-470971e54d8e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.487544 Aug 03 18:57:35.293877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 374/728] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:34 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:57:35.783369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:35.784015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:35.790536 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:35.791024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:35.791791 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:35.792233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:35.922134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:35.929754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-52e030a7-74bd-458e-9e2f-ccb0a1676d1a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1663 microversion: 2.1 time: 0.150843 Aug 03 18:57:35.930327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 355/729] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:35 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:36.315701 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:36.316332 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:36.323205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:36.323628 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:36.324537 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:36.325159 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:36.474021 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:36.481874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-150b1f86-483a-4b93-9a99-daae60ab9194 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.170899 Aug 03 18:57:36.482448 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 375/730] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:36 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:36.951067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:36.951617 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:36.958564 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:36.959014 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:36.959768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:36.960198 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:37.089639 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:37.097614 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-26454c25-9d0e-422b-873b-582d27a54488 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1667 microversion: 2.1 time: 0.150492 Aug 03 18:57:37.098192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 356/731] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:36 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:37.503385 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:37.504036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:37.510801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:37.511259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:37.512030 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:37.512508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:37.657969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:37.665944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-97cce280-ec00-431f-a486-b0136e92fb28 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.166753 Aug 03 18:57:37.666510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 376/732] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:37 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:38.687268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:38.687811 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:38.695542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:38.695997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:38.696792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:38.697237 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:38.842621 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:38.847216 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:38.852624 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9f1db503-952e-48fc-8045-b85a319cedbb tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1758 microversion: 2.1 time: 0.169389 Aug 03 18:57:38.853202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 357/733] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:38 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:39.873458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:39.874073 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:39.881636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:39.882088 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:39.882852 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:39.883289 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:40.025879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:40.034417 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ef5dda0d-40cf-4ebb-b12f-4a0864f66ca3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1761 microversion: 2.1 time: 0.164833 Aug 03 18:57:40.034986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 377/734] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:57:39 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1761 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:45.618609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-840c659e-5df4-43e5-b6fa-629cdf749d5e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:45.619154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-840c659e-5df4-43e5-b6fa-629cdf749d5e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:45.628277 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-840c659e-5df4-43e5-b6fa-629cdf749d5e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:45.628756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-840c659e-5df4-43e5-b6fa-629cdf749d5e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:45.629532 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-840c659e-5df4-43e5-b6fa-629cdf749d5e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:45.629974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-840c659e-5df4-43e5-b6fa-629cdf749d5e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:45.658016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-840c659e-5df4-43e5-b6fa-629cdf749d5e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments/03f109b1-0350-4320-b4ba-f45692a3a21e" status: 200 len: 194 microversion: 2.20 time: 0.043433 Aug 03 18:57:45.658590 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 358/735] 10.222.0.69 () {60 vars in 1454 bytes} [Wed Aug 3 18:57:45 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments/03f109b1-0350-4320-b4ba-f45692a3a21e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:57:45.724494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:45.725001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:45.731237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:45.731693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:45.732501 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:45.732946 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:45.814121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lazy-loading 'services' on Instance uuid 75afca33-3ec7-4c03-9d25-a247fc1e47bd {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:57:45.886381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-47f13977-dd5e-4ebd-aa83-bad647ee0c49 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments/03f109b1-0350-4320-b4ba-f45692a3a21e" status: 202 len: 0 microversion: 2.20 time: 0.165823 Aug 03 18:57:45.887066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 378/736] 10.222.0.69 () {60 vars in 1457 bytes} [Wed Aug 3 18:57:45 2022] DELETE /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments/03f109b1-0350-4320-b4ba-f45692a3a21e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:57:45.896098 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-297bd9ae-4f8e-436f-8ce9-6e7e781dc321 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:45.898928 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-297bd9ae-4f8e-436f-8ce9-6e7e781dc321 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:45.904635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297bd9ae-4f8e-436f-8ce9-6e7e781dc321 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:45.905068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297bd9ae-4f8e-436f-8ce9-6e7e781dc321 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:45.905836 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297bd9ae-4f8e-436f-8ce9-6e7e781dc321 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:45.906271 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-297bd9ae-4f8e-436f-8ce9-6e7e781dc321 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:45.939233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-297bd9ae-4f8e-436f-8ce9-6e7e781dc321 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045937 Aug 03 18:57:45.939648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 359/737] 10.222.0.69 () {60 vars in 1343 bytes} [Wed Aug 3 18:57:45 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 18:57:46.953132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-647ca2cf-975d-4f26-9650-5f0e3e5fcaff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:46.956200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-647ca2cf-975d-4f26-9650-5f0e3e5fcaff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:46.962512 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-647ca2cf-975d-4f26-9650-5f0e3e5fcaff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:46.962950 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-647ca2cf-975d-4f26-9650-5f0e3e5fcaff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:46.963706 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-647ca2cf-975d-4f26-9650-5f0e3e5fcaff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:46.964135 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-647ca2cf-975d-4f26-9650-5f0e3e5fcaff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:46.992011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-647ca2cf-975d-4f26-9650-5f0e3e5fcaff tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044419 Aug 03 18:57:46.992595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 379/738] 10.222.0.69 () {60 vars in 1343 bytes} [Wed Aug 3 18:57:46 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:57:47.054652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:47.055192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:47.057528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=37 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:47.063701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:47.064208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:47.065064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:47.065590 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:47.092549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:57:47.170520 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9e612f54-8df3-4f50-9587-24c8362a8865 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 204 len: 0 microversion: 2.20 time: 0.119453 Aug 03 18:57:47.171195 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 360/739] 10.222.0.69 () {60 vars in 1280 bytes} [Wed Aug 3 18:57:47 2022] DELETE /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 18:57:47.180486 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:47.181102 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:47.187084 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:47.187529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:47.189207 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:47.189658 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:47.324555 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:47.332622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:47.334112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:47.335264 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7c8e41d3-0e71-40cc-baaa-1ece4f68005a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.158752 Aug 03 18:57:47.335816 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 380/740] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:47 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:57:48.363366 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:48.364069 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:48.370642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:48.371093 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:48.371866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:48.372324 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:48.505832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:48.513729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:48.515225 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:48.516567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-47ca23e5-f779-4295-966c-a463dfc68bb3 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.158403 Aug 03 18:57:48.517130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 361/741] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:48 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:49.540090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:49.540731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:49.543131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=41 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:57:49.549044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:49.549492 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:49.550286 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:49.550771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:49.826820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:49.835966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:49.837499 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:49.838703 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a197d4d2-6691-46fc-a7f6-8eda906e242c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1723 microversion: 2.20 time: 0.302671 Aug 03 18:57:49.839310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 381/742] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:49 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:50.343551 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-e606a2e9-b3ec-4399-a84f-7d42f4716e8e req-c7740f0c-d4ca-430b-a8fa-5657624f13c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75afca33-3ec7-4c03-9d25-a247fc1e47bd", "name": "network-vif-deleted", "tag": "1407aa85-6899-475c-a3c7-c06872937b88"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:50.355044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-e606a2e9-b3ec-4399-a84f-7d42f4716e8e req-c7740f0c-d4ca-430b-a8fa-5657624f13c0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:50.355817 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-e606a2e9-b3ec-4399-a84f-7d42f4716e8e req-c7740f0c-d4ca-430b-a8fa-5657624f13c0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:50.368077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-e606a2e9-b3ec-4399-a84f-7d42f4716e8e req-c7740f0c-d4ca-430b-a8fa-5657624f13c0 service nova] Creating event network-vif-deleted:1407aa85-6899-475c-a3c7-c06872937b88 for instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd on hv-cinder-85164 Aug 03 18:57:50.373670 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-e606a2e9-b3ec-4399-a84f-7d42f4716e8e req-c7740f0c-d4ca-430b-a8fa-5657624f13c0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033690 Aug 03 18:57:50.374388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 362/743] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:57:50.863020 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:50.863648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:50.870345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:50.870798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:50.871564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:50.872176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:50.905378 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:50.905823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:50.906277 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lazy-loading 'fault' on Instance uuid 75afca33-3ec7-4c03-9d25-a247fc1e47bd {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:57:50.959107 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:50.967036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:50.969620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:50.971152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fc84f184-3d30-49f7-9739-ec1a33757608 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 200 len: 1372 microversion: 2.20 time: 0.113011 Aug 03 18:57:50.971799 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 382/744] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:50 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:51.994852 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:51.995657 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:52.003103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:52.003559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:52.004362 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:52.004848 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:52.019227 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] HTTP exception thrown: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Request method failure captured: Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd HTTP/1.1 Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN3rUmVZtIYkiVe309NJBmWr-ptK3htRkqlFPQDvmSRggvaS-GgzKiKUKl8W6hnwUvaZy7ZAeduAIHMRylnP9RNdKV4aHpnOFf5-hrOKkWKKbQCvR07YGAMhxtIi1ivCmI-Y2j6504bp0DQBkp2wgzBBS5_Zsv53uonYs20YJNu6SM Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: e125626c9566484b837b582ba7096598 Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:57:52.021000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e125626c9566484b837b582ba7096598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e125626c9566484b837b582ba7096598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: e125626c9566484b837b582ba7096598 Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1aa1d56d9b154e32aa1c136b577d49f4 Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 18:57:52.022717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '75afca33-3ec7-4c03-9d25-a247fc1e47bd'} Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:57:52.027082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 18:57:52.028595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:57:52.030458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Returning 404 to user: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:57:52.030458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-70644182-fc17-477b-bc16-c35786df862d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 404 len: 111 microversion: 2.20 time: 0.032445 Aug 03 18:57:52.030458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 363/745] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:51 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 18:57:52.034065 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2e8abc09-1f65-49ef-a47b-c29c224ea77b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '.version_select at 0x7fdac9e9b700>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:52.057217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2e8abc09-1f65-49ef-a47b-c29c224ea77b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133230986" status: 204 len: 0 microversion: 2.20 time: 0.028526 Aug 03 18:57:52.057904 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 383/746] 10.222.0.69 () {60 vars in 1262 bytes} [Wed Aug 3 18:57:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133230986 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 18:57:52.756052 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5f443bf2-8972-4438-85c1-5dfd4c879390 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'create', calling method: .version_select at 0x7fdac9efaaf0>, body: {"keypair": {"name": "tempest-keypair-989757676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBIDeHQMCs9tipvTZHP8lG0AhQQl7q8QlTfS/wrlcmSA8iNu8uNWnGF9uhFo84Yn9adRRdLQUkXzQch0i1NDKalnkZubeThGArLyk3mcYm8BdgLaIyuX+fh09t0P+KYAQ=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:52.771558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-5f443bf2-8972-4438-85c1-5dfd4c879390 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for project e125626c9566484b837b582ba7096598. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:57:52.775339 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-5f443bf2-8972-4438-85c1-5dfd4c879390 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for user 1aa1d56d9b154e32aa1c136b577d49f4 and project e125626c9566484b837b582ba7096598. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:57:52.796905 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5f443bf2-8972-4438-85c1-5dfd4c879390 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044668 Aug 03 18:57:52.797446 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 364/747] 10.222.0.69 () {62 vars in 1200 bytes} [Wed Aug 3 18:57:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 18:57:54.068828 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1165883160", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77f2cd46-7c63-471b-8d5f-e72bc8dfc1dd"}], "security_groups": [{"name": "tempest-securitygroup--1553003509"}], "key_name": "tempest-keypair-989757676", "user_data": "}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:54.176844 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] validate_networks() for [('77f2cd46-7c63-471b-8d5f-e72bc8dfc1dd', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:57:54.639469 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:57:54.639908 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:57:54.640485 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:57:54.641586 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:57:54.642187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:57:54.650937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:54.651393 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:54.652192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:54.652666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:54.670233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for project e125626c9566484b837b582ba7096598. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:57:54.674213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Getting quotas for user 1aa1d56d9b154e32aa1c136b577d49f4 and project e125626c9566484b837b582ba7096598. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:57:54.685172 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:57:54.687344 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:57:54.734209 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-19698d0d-43e6-4f21-9019-cab322e982af tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.669661 Aug 03 18:57:54.735023 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 384/748] 10.222.0.69 () {62 vars in 1188 bytes} [Wed Aug 3 18:57:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 18:57:54.746465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-62cb1c3b-e99c-4b3c-aac4-8024581f9d73 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:54.747184 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-62cb1c3b-e99c-4b3c-aac4-8024581f9d73 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:54.803132 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-62cb1c3b-e99c-4b3c-aac4-8024581f9d73 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:54.810635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-62cb1c3b-e99c-4b3c-aac4-8024581f9d73 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:54.812206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-62cb1c3b-e99c-4b3c-aac4-8024581f9d73 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:54.813710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-62cb1c3b-e99c-4b3c-aac4-8024581f9d73 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1281 microversion: 2.20 time: 0.071582 Aug 03 18:57:54.814255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 365/749] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:54 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:55.835755 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:55.837217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:55.844864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:55.845558 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:55.846503 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:55.847127 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:55.926885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:55.938494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:55.940429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:55.941570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-508906d8-1cb2-4681-b07c-c9addade1e46 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1351 microversion: 2.20 time: 0.109751 Aug 03 18:57:55.942158 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 385/750] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:55 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:56.965616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:56.967249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:56.973406 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:56.973861 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:56.974638 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:56.975084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:57.440199 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:57.448451 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:57.450002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:57.451077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d1d225de-5d49-4d68-9cc7-f06a6be9e675 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.490245 Aug 03 18:57:57.451918 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 366/751] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:56 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:57.659295 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-b07323a4-aa20-46ed-a009-993b7e3435d9 req-b587d2f8-eef9-491e-abab-9b24e9935e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b197c2f4-4c3c-44a2-a777-6ac04cddbb4d", "tag": "3c6f8293-ee04-4b19-94b1-87cab0643fb5"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:57:57.670979 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b07323a4-aa20-46ed-a009-993b7e3435d9 req-b587d2f8-eef9-491e-abab-9b24e9935e02 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:57.671429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b07323a4-aa20-46ed-a009-993b7e3435d9 req-b587d2f8-eef9-491e-abab-9b24e9935e02 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:57.684281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-b07323a4-aa20-46ed-a009-993b7e3435d9 req-b587d2f8-eef9-491e-abab-9b24e9935e02 service nova] Creating event network-changed:3c6f8293-ee04-4b19-94b1-87cab0643fb5 for instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d on hv-cinder-85164 Aug 03 18:57:57.689403 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-b07323a4-aa20-46ed-a009-993b7e3435d9 req-b587d2f8-eef9-491e-abab-9b24e9935e02 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034366 Aug 03 18:57:57.690602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 386/752] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:57:58.474992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:58.475610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:58.482077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:58.482531 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:58.483298 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:58.483738 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:58.613642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:58.622091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:58.623855 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:58.625051 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d1530219-6dac-48ba-bbb6-6a8f70cd6acf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.154032 Aug 03 18:57:58.625705 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 367/753] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:58 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:57:59.648002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:57:59.648727 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:57:59.655338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:59.655785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:59.657619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:57:59.658061 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:57:59.798653 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:59.808081 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:59.809625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:57:59.810756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3b3bb5a7-90d9-46b2-85a9-c514168474bd tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.167125 Aug 03 18:57:59.811323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 387/754] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:57:59 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:58:00.833338 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:00.833960 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:00.840463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:00.840922 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:00.841703 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:00.842150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:01.037428 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:01.045571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:01.047637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:01.048785 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b6b9d0c2-b35d-4417-a79e-d9cfa6a3efe4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.220382 Aug 03 18:58:01.049350 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 368/755] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:58:00 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:58:02.071031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:02.071636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:02.078133 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:02.078593 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:02.079463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:02.079906 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:02.219501 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:02.227568 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:02.229214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:02.230409 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2903c296-7bed-426c-99ea-4b1f5c594df2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.163343 Aug 03 18:58:02.231081 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 388/756] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:58:02 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:58:03.254053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:03.254675 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:03.261474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:03.262131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:03.262922 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:03.263369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:03.404136 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:03.414029 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:03.415556 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:03.416814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-35f3c05d-6bb5-4c5e-baf3-9337a605e4c1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.167552 Aug 03 18:58:03.417891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 369/757] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:58:03 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:58:04.153494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-e05b2c81-8b9d-41f1-97bf-b670d19177cd req-cf101182-65f6-4c41-ae2b-8fe6699d8e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b197c2f4-4c3c-44a2-a777-6ac04cddbb4d", "name": "network-vif-plugged", "status": "completed", "tag": "3c6f8293-ee04-4b19-94b1-87cab0643fb5"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:04.164064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-e05b2c81-8b9d-41f1-97bf-b670d19177cd req-cf101182-65f6-4c41-ae2b-8fe6699d8e2e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:04.164544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-e05b2c81-8b9d-41f1-97bf-b670d19177cd req-cf101182-65f6-4c41-ae2b-8fe6699d8e2e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:04.176338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-e05b2c81-8b9d-41f1-97bf-b670d19177cd req-cf101182-65f6-4c41-ae2b-8fe6699d8e2e service nova] Creating event network-vif-plugged:3c6f8293-ee04-4b19-94b1-87cab0643fb5 for instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d on hv-cinder-85164 Aug 03 18:58:04.181220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-e05b2c81-8b9d-41f1-97bf-b670d19177cd req-cf101182-65f6-4c41-ae2b-8fe6699d8e2e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031460 Aug 03 18:58:04.181824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 389/758] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:04.442201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:04.442809 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:04.448776 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:04.449160 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:04.449943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:04.450364 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:04.589324 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:04.598042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:04.599559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:04.600715 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-43977e63-07b1-40ef-8fd1-c23bb412d649 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.163011 Aug 03 18:58:04.601279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 370/759] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:58:04 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:58:05.620955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:05.621633 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:05.627984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:05.628682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:05.635749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:05.636214 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:05.636993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:05.637414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:05.639965 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:05.771167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:05.779084 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:05.780636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:05.781753 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d9c41ca0-5e23-4566-90e4-c3478713374d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1407 microversion: 2.20 time: 0.162068 Aug 03 18:58:05.782564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 390/760] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:58:05 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:58:06.198768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:06.199275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:06.201170 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:06.207011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.207469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:06.208242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.208715 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:06.290284 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lazy-loading 'services' on Instance uuid 7cc1c313-9332-403b-bbe5-63a6c2166815 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:58:06.366827 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4f963b26-1aa1-4bcb-be8d-de03e217ecd0 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments/547180e8-67be-49d5-97fb-42e6c06cb496" status: 202 len: 0 microversion: 2.1 time: 0.171876 Aug 03 18:58:06.367419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 371/761] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 18:58:06 2022] DELETE /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments/547180e8-67be-49d5-97fb-42e6c06cb496 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:58:06.378561 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-eadf3ea8-ae64-4c61-bce4-f9197845875b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:06.380903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-eadf3ea8-ae64-4c61-bce4-f9197845875b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:06.386972 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eadf3ea8-ae64-4c61-bce4-f9197845875b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.387419 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eadf3ea8-ae64-4c61-bce4-f9197845875b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:06.388176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eadf3ea8-ae64-4c61-bce4-f9197845875b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.388651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eadf3ea8-ae64-4c61-bce4-f9197845875b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:06.419405 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-eadf3ea8-ae64-4c61-bce4-f9197845875b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046118 Aug 03 18:58:06.419964 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 391/762] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 18:58:06 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:06.804702 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:06.805427 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:06.811672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.812117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:06.812921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.814005 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:06.945645 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:06.953551 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:06.955789 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:06.957027 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a86c511e-1a8c-450c-bca3-aca47ee92e0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1598 microversion: 2.20 time: 0.157216 Aug 03 18:58:06.957593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 372/763] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:58:06 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:58:06.979855 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d772a54c-bda6-48fa-b2f4-2ce111fc7ce0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:06.980385 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d772a54c-bda6-48fa-b2f4-2ce111fc7ce0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:06.988413 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d772a54c-bda6-48fa-b2f4-2ce111fc7ce0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.988868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d772a54c-bda6-48fa-b2f4-2ce111fc7ce0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:06.989640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d772a54c-bda6-48fa-b2f4-2ce111fc7ce0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:06.990079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d772a54c-bda6-48fa-b2f4-2ce111fc7ce0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:07.071887 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d772a54c-bda6-48fa-b2f4-2ce111fc7ce0 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096077 Aug 03 18:58:07.072514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 392/764] 10.222.0.69 () {60 vars in 1316 bytes} [Wed Aug 3 18:58:06 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:58:07.431990 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3e669571-26d8-4262-9b6f-61bf21223f52 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:07.434255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3e669571-26d8-4262-9b6f-61bf21223f52 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:07.441849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e669571-26d8-4262-9b6f-61bf21223f52 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:07.442299 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e669571-26d8-4262-9b6f-61bf21223f52 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:07.443062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e669571-26d8-4262-9b6f-61bf21223f52 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:07.443496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3e669571-26d8-4262-9b6f-61bf21223f52 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:07.473405 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3e669571-26d8-4262-9b6f-61bf21223f52 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045435 Aug 03 18:58:07.473983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 373/765] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 18:58:07 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:08.289651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-c2deb962-8262-4b62-bcc1-bf4b5fa1d0af req-36a88c2e-253c-4855-a7c4-59568f1f9ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b197c2f4-4c3c-44a2-a777-6ac04cddbb4d", "tag": "3c6f8293-ee04-4b19-94b1-87cab0643fb5"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:08.299576 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-c2deb962-8262-4b62-bcc1-bf4b5fa1d0af req-36a88c2e-253c-4855-a7c4-59568f1f9ce3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:08.300023 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-c2deb962-8262-4b62-bcc1-bf4b5fa1d0af req-36a88c2e-253c-4855-a7c4-59568f1f9ce3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:08.314122 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-c2deb962-8262-4b62-bcc1-bf4b5fa1d0af req-36a88c2e-253c-4855-a7c4-59568f1f9ce3 service nova] Creating event network-changed:3c6f8293-ee04-4b19-94b1-87cab0643fb5 for instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d on hv-cinder-85164 Aug 03 18:58:08.319404 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-c2deb962-8262-4b62-bcc1-bf4b5fa1d0af req-36a88c2e-253c-4855-a7c4-59568f1f9ce3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092875 Aug 03 18:58:08.320063 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 393/766] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:08.486801 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-93e8f00e-b97e-4fbd-a5c9-02d9383bb624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:08.489132 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-93e8f00e-b97e-4fbd-a5c9-02d9383bb624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:08.496482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93e8f00e-b97e-4fbd-a5c9-02d9383bb624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:08.497187 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93e8f00e-b97e-4fbd-a5c9-02d9383bb624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:08.497956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93e8f00e-b97e-4fbd-a5c9-02d9383bb624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:08.498549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-93e8f00e-b97e-4fbd-a5c9-02d9383bb624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:08.531709 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-93e8f00e-b97e-4fbd-a5c9-02d9383bb624 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049865 Aug 03 18:58:08.533051 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 374/767] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 18:58:08 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 18:58:08.609781 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:08.610620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:08.617482 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:08.617937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:08.618718 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:08.619162 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:08.659394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:58:08.745460 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1bac06c5-ae3b-4a09-aff4-d596effd9ba1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 204 len: 0 microversion: 2.1 time: 0.139335 Aug 03 18:58:08.746218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 394/768] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:58:08 2022] DELETE /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:58:08.755849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:08.756832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:08.763150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:08.763859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:08.764957 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:08.765460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:08.786244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:08.903418 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:08.911936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d35db35b-7c6e-4ad7-bd1d-84d4b0f5f6ab tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1686 microversion: 2.1 time: 0.161289 Aug 03 18:58:08.912545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 375/769] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:08 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:09.933411 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:09.934101 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:09.941412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:09.941859 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:09.942615 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:09.943045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:10.079807 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:10.087260 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-00c0aebe-b6f9-42a2-aaef-a9d65a611739 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1686 microversion: 2.1 time: 0.158035 Aug 03 18:58:10.087828 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 395/770] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:09 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:11.108745 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:11.109361 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:11.116457 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:11.116914 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:11.117683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:11.118126 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:11.253850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:11.261327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6e7b128a-ce15-42b0-a07f-5ed24fdb08e1 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1686 microversion: 2.1 time: 0.156473 Aug 03 18:58:11.261894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 376/771] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:11 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:12.283253 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:12.283911 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:12.292131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:12.292747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:12.293756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:12.294367 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:12.439523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:12.447030 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-693b7bd1-dc9b-41d8-b1d0-e14d247c5f70 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1686 microversion: 2.1 time: 0.168485 Aug 03 18:58:12.447634 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 396/772] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:12 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:13.468394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:13.469125 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:13.476225 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:13.476761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:13.477532 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:13.477964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:13.558055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:13.567089 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-beeb1e94-48b2-4ded-b98c-a9eea154b8c2 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 200 len: 1619 microversion: 2.1 time: 0.102511 Aug 03 18:58:13.567662 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 377/773] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:13 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 1619 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:13.587555 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-f6079ccd-5cd3-4044-8025-b1ad203aeafb req-2358de89-468c-4fdb-a7bd-d05465890910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc1c313-9332-403b-bbe5-63a6c2166815", "name": "network-vif-deleted", "tag": "f1ac9290-e7c9-4c16-a9e9-ca539d39ba80"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:13.598944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-f6079ccd-5cd3-4044-8025-b1ad203aeafb req-2358de89-468c-4fdb-a7bd-d05465890910 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:13.599472 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-f6079ccd-5cd3-4044-8025-b1ad203aeafb req-2358de89-468c-4fdb-a7bd-d05465890910 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:13.612675 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-f6079ccd-5cd3-4044-8025-b1ad203aeafb req-2358de89-468c-4fdb-a7bd-d05465890910 service nova] Creating event network-vif-deleted:f1ac9290-e7c9-4c16-a9e9-ca539d39ba80 for instance 7cc1c313-9332-403b-bbe5-63a6c2166815 on hv-cinder-85164 Aug 03 18:58:13.618359 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-f6079ccd-5cd3-4044-8025-b1ad203aeafb req-2358de89-468c-4fdb-a7bd-d05465890910 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034050 Aug 03 18:58:13.620581 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 397/774] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:14.589625 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:14.590250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: 7cc1c313-9332-403b-bbe5-63a6c2166815] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:14.597068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:14.597518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:14.598294 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:14.598733 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:14.613270 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] HTTP exception thrown: Instance 7cc1c313-9332-403b-bbe5-63a6c2166815 could not be found. Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Request method failure captured: Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 HTTP/1.1 Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNvll95s2JABXcKEHVk4FbLHf6AY01rjPFZb7Nx52UR3RxU4xxPzYx0vbmghA_JCPLuql4FzknWrFab_fMCoDQDUGDtTlqhU86sCalI4Gc9fkhX8_AyMiJER3bu2xysUFlZkf2p1YAAXNMbA5rgUo0ARE4ZuPEOzCnvsmmUzx2UILk Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:58:14.614991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: c6085ba9dff1480a8a1674e492e0c6c3 Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 7cc1c313-9332-403b-bbe5-63a6c2166815 could not be found. Aug 03 18:58:14.616628 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '7cc1c313-9332-403b-bbe5-63a6c2166815'} Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc1c313-9332-403b-bbe5-63a6c2166815 could not be found. Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:58:14.617510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc1c313-9332-403b-bbe5-63a6c2166815 could not be found. Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc1c313-9332-403b-bbe5-63a6c2166815 could not be found. Aug 03 18:58:14.618720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:14.619818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Returning 404 to user: Instance 7cc1c313-9332-403b-bbe5-63a6c2166815 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:58:14.619818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d02c46bf-ad82-49ce-89b1-51219b86244c tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815" status: 404 len: 111 microversion: 2.1 time: 0.030916 Aug 03 18:58:14.619818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 378/775] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:14 2022] GET /compute/v2.1/servers/7cc1c313-9332-403b-bbe5-63a6c2166815 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:58:14.627292 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fd3ff824-c5e6-458d-886a-411b990b165b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '.version_select at 0x7fdaca004700>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:14.647286 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fd3ff824-c5e6-458d-886a-411b990b165b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-64207063" status: 202 len: 0 microversion: 2.1 time: 0.025446 Aug 03 18:58:14.647879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 398/776] 10.222.0.69 () {58 vars in 1215 bytes} [Wed Aug 3 18:58:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-64207063 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 18:58:17.552399 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:17.552893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:17.554859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:17.560940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:17.561394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:17.562165 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:17.562605 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:17.590303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:58:17.665141 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a9ada83a-7542-4c5b-a1c2-ef1e78ed0ba8 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 204 len: 0 microversion: 2.1 time: 0.116535 Aug 03 18:58:17.665723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 379/777] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:58:17 2022] DELETE /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:58:17.676119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:17.676901 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:17.683943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:17.684465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:17.685241 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:17.685685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:17.818681 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:17.826538 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-07bfe1f5-560f-4dfe-9973-f1ebdf00d5e5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1506 microversion: 2.1 time: 0.155882 Aug 03 18:58:17.827112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 399/778] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:17 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:18.850046 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:18.850753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:18.856839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:18.857233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:18.858005 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:18.858444 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:19.080146 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:19.088558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c4206991-3186-435e-bad3-2c6b8e135781 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 200 len: 1506 microversion: 2.1 time: 0.243207 Aug 03 18:58:19.089311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 380/779] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:18 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:19.112524 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-27838954-5ebf-4317-acd5-36d5c6361d8d req-1bde7fb2-c08e-4aba-b500-a16ae3664c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab63b03-b37e-4d91-afa5-6b01ae41f2e6", "name": "network-vif-deleted", "tag": "109d7749-0d32-4e07-97a5-8d873fc9a14c"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:19.137140 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-27838954-5ebf-4317-acd5-36d5c6361d8d req-1bde7fb2-c08e-4aba-b500-a16ae3664c42 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:19.137587 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-27838954-5ebf-4317-acd5-36d5c6361d8d req-1bde7fb2-c08e-4aba-b500-a16ae3664c42 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:19.152380 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-27838954-5ebf-4317-acd5-36d5c6361d8d req-1bde7fb2-c08e-4aba-b500-a16ae3664c42 service nova] Creating event network-vif-deleted:109d7749-0d32-4e07-97a5-8d873fc9a14c for instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 on hv-cinder-85164 Aug 03 18:58:19.159440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-27838954-5ebf-4317-acd5-36d5c6361d8d req-1bde7fb2-c08e-4aba-b500-a16ae3664c42 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050591 Aug 03 18:58:19.160045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 400/780] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:20.111501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:20.112222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: bab63b03-b37e-4d91-afa5-6b01ae41f2e6] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:20.119154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:20.119611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:20.120435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:20.120883 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:20.135111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] HTTP exception thrown: Instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 could not be found. Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Request method failure captured: Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 HTTP/1.1 Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sNvll95s2JABXcKEHVk4FbLHf6AY01rjPFZb7Nx52UR3RxU4xxPzYx0vbmghA_JCPLuql4FzknWrFab_fMCoDQDUGDtTlqhU86sCalI4Gc9fkhX8_AyMiJER3bu2xysUFlZkf2p1YAAXNMbA5rgUo0ARE4ZuPEOzCnvsmmUzx2UILk Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:58:20.136816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: c6085ba9dff1480a8a1674e492e0c6c3 Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 could not be found. Aug 03 18:58:20.138462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'bab63b03-b37e-4d91-afa5-6b01ae41f2e6'} Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 could not be found. Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:58:20.139421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 could not be found. Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 could not be found. Aug 03 18:58:20.140958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:20.142954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Returning 404 to user: Instance bab63b03-b37e-4d91-afa5-6b01ae41f2e6 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:58:20.142954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-620fcb43-9565-4d8f-bf65-456942dce6c5 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6" status: 404 len: 111 microversion: 2.1 time: 0.031375 Aug 03 18:58:20.142954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 381/781] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:20 2022] GET /compute/v2.1/servers/bab63b03-b37e-4d91-afa5-6b01ae41f2e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:58:20.148319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:20.148913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:20.151345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:20.157432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:20.157976 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:20.158751 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:20.159205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:20.188840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:58:20.262733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d66e8cef-6fe9-4c13-824c-47a6934859c4 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "DELETE /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 204 len: 0 microversion: 2.1 time: 0.118385 Aug 03 18:58:20.263311 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 401/782] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:58:20 2022] DELETE /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:58:20.273336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:20.273960 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:20.280019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:20.280524 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:20.281296 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:20.282313 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:20.419678 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:20.428163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7c26a6a8-d6ed-4a5c-81b0-7f8fa4694e6f tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.159296 Aug 03 18:58:20.428767 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 382/783] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:20 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:21.450085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:21.450909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:21.460520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:21.460983 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:21.461770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:21.462211 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:21.710592 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6085ba9dff1480a8a1674e492e0c6c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81ddb9c7b0f442df80831cc49287fd57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:21.718106 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-466241ef-4636-467c-ade3-d8b5cc2dcd9b tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 200 len: 1521 microversion: 2.1 time: 0.272481 Aug 03 18:58:21.718679 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 402/784] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:21 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:21.894100 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-73ac84bc-781a-424f-95b3-a8271ee93f5d req-8aa18d08-f7de-4ac1-9d6a-c6e54db4459e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeaec340-ee41-4cc1-9812-e9840770a738", "name": "network-vif-deleted", "tag": "48af6877-730c-4819-a241-1d10a1f9f608"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:21.905951 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-73ac84bc-781a-424f-95b3-a8271ee93f5d req-8aa18d08-f7de-4ac1-9d6a-c6e54db4459e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:21.906393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-73ac84bc-781a-424f-95b3-a8271ee93f5d req-8aa18d08-f7de-4ac1-9d6a-c6e54db4459e service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:21.919588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-73ac84bc-781a-424f-95b3-a8271ee93f5d req-8aa18d08-f7de-4ac1-9d6a-c6e54db4459e service nova] Creating event network-vif-deleted:48af6877-730c-4819-a241-1d10a1f9f608 for instance eeaec340-ee41-4cc1-9812-e9840770a738 on hv-cinder-85164 Aug 03 18:58:21.926139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-73ac84bc-781a-424f-95b3-a8271ee93f5d req-8aa18d08-f7de-4ac1-9d6a-c6e54db4459e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037428 Aug 03 18:58:21.927478 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 383/785] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:22.739651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:22.740243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] [instance: eeaec340-ee41-4cc1-9812-e9840770a738] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:22.746304 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:22.746756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:22.747519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:22.747958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:22.762177 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] HTTP exception thrown: Instance eeaec340-ee41-4cc1-9812-e9840770a738 could not be found. Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Request method failure captured: Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 HTTP/1.1 Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sNvll95s2JABXcKEHVk4FbLHf6AY01rjPFZb7Nx52UR3RxU4xxPzYx0vbmghA_JCPLuql4FzknWrFab_fMCoDQDUGDtTlqhU86sCalI4Gc9fkhX8_AyMiJER3bu2xysUFlZkf2p1YAAXNMbA5rgUo0ARE4ZuPEOzCnvsmmUzx2UILk Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:58:22.764245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/81ddb9c7b0f442df80831cc49287fd57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 81ddb9c7b0f442df80831cc49287fd57 Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-414936689 Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: c6085ba9dff1480a8a1674e492e0c6c3 Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-ServerRescueNegativeTestJSON-414936689-project Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance eeaec340-ee41-4cc1-9812-e9840770a738 could not be found. Aug 03 18:58:22.765833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'eeaec340-ee41-4cc1-9812-e9840770a738'} Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeaec340-ee41-4cc1-9812-e9840770a738 could not be found. Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:58:22.766853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeaec340-ee41-4cc1-9812-e9840770a738 could not be found. Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeaec340-ee41-4cc1-9812-e9840770a738 could not be found. Aug 03 18:58:22.768588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:22.770138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] Returning 404 to user: Instance eeaec340-ee41-4cc1-9812-e9840770a738 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:58:22.770138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0a58959e-442f-4283-83db-7b188390f8c3 tempest-ServerRescueNegativeTestJSON-414936689 tempest-ServerRescueNegativeTestJSON-414936689-project] 10.222.0.69 "GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738" status: 404 len: 111 microversion: 2.1 time: 0.031050 Aug 03 18:58:22.770138 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 403/786] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:22 2022] GET /compute/v2.1/servers/eeaec340-ee41-4cc1-9812-e9840770a738 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:58:27.832249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0e3d246c-8cae-4227-96ff-f55cc44b05c6 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Action: 'create', calling method: .version_select at 0x7fdac9f1cf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2054404258", "metadata": {"Type": "work"}}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:28.135054 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0e3d246c-8cae-4227-96ff-f55cc44b05c6 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.443698 Aug 03 18:58:28.135774 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 384/787] 10.222.0.69 () {60 vars in 1156 bytes} [Wed Aug 3 18:58:27 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 445 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 18:58:28.149905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-07f7bf6e-78f7-4e37-a7bc-dba01817606a tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Calling method '.version_select at 0x7fdac9e53a60>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:28.201676 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-07f7bf6e-78f7-4e37-a7bc-dba01817606a tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876" status: 200 len: 353 microversion: 2.1 time: 0.056387 Aug 03 18:58:28.202248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 404/788] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:58:28 2022] GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:29.217602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-08ea7e26-c25b-44ed-af08-7b31dbaa3f55 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Calling method '.version_select at 0x7fdac9ea50d0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:29.266592 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-08ea7e26-c25b-44ed-af08-7b31dbaa3f55 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876" status: 200 len: 354 microversion: 2.1 time: 0.054260 Aug 03 18:58:29.267181 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 385/789] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:58:29 2022] GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:29.279786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-efad3755-5130-4972-a516-1e0c5aee0dd0 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Calling method '.version_select at 0x7fdac9d97f70>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:29.329592 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-efad3755-5130-4972-a516-1e0c5aee0dd0 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876" status: 200 len: 354 microversion: 2.1 time: 0.053843 Aug 03 18:58:29.330167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 405/790] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:58:29 2022] GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:29.347930 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2ffb62dd-4bff-40e5-b91f-319c69feb270 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Calling method '.version_select at 0x7fdaca034c10>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:29.409681 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2ffb62dd-4bff-40e5-b91f-319c69feb270 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876" status: 202 len: 0 microversion: 2.1 time: 0.066012 Aug 03 18:58:29.410265 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 386/791] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 18:58:29 2022] DELETE /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:58:29.418647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-94cbe295-a336-4be0-bbdf-9565d3e32e8c tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Calling method '.version_select at 0x7fdaca061820>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:29.472537 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-94cbe295-a336-4be0-bbdf-9565d3e32e8c tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876" status: 200 len: 353 microversion: 2.1 time: 0.058024 Aug 03 18:58:29.473459 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 406/792] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:58:29 2022] GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:30.488546 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-19f3040e-10f4-4c99-8865-f997083ccc27 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Calling method '.version_select at 0x7fdac9f1c940>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:30.518447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-19f3040e-10f4-4c99-8865-f997083ccc27 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] HTTP exception thrown: Volume 1685937f-f379-4fae-bd6d-3995688c4876 could not be found. Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-19f3040e-10f4-4c99-8865-f997083ccc27 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Request method failure captured: Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876 HTTP/1.1 Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sVTLBWrdZSAyZTDmMMCTT5Q2Xc-jzaQKZihA-DnAl7TCHkDrKxPzoxQ-fLdpN7z9CfyMUHOC-SbmRC95wqu7CFoo0rS7xlRh4VgRz3OCC1brlXrLkLrwVgXZMMPGy3B7bjjH7BWE8og7Jz3sQsdU9V4rpYsf4QFIzboq7LCfTs-eRA Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 3fbd942e274a4c83a5ea3fe3f0b08c9b Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-VolumesGetTestJSON-745494093 Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:58:30.520554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/3fbd942e274a4c83a5ea3fe3f0b08c9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3fbd942e274a4c83a5ea3fe3f0b08c9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_3fbd942e274a4c83a5ea3fe3f0b08c9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/3fbd942e274a4c83a5ea3fe3f0b08c9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-VolumesGetTestJSON-745494093 Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 3fbd942e274a4c83a5ea3fe3f0b08c9b Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-VolumesGetTestJSON-745494093 Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-VolumesGetTestJSON-745494093-project Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: e411fd6d51164ed79af6bf7e4b51bb2e Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-VolumesGetTestJSON-745494093-project Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Volume 1685937f-f379-4fae-bd6d-3995688c4876 could not be found. Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '1685937f-f379-4fae-bd6d-3995688c4876'} Aug 03 18:58:30.522120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1685937f-f379-4fae-bd6d-3995688c4876 could not be found. (HTTP 404) (Request-ID: req-786bd9d8-d3e1-473f-9a03-ba9bd8848470) Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:30.523218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 18:58:30.524787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1685937f-f379-4fae-bd6d-3995688c4876 could not be found. Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 18:58:30.526138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1685937f-f379-4fae-bd6d-3995688c4876 could not be found. Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1685937f-f379-4fae-bd6d-3995688c4876 could not be found. Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-19f3040e-10f4-4c99-8865-f997083ccc27 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] Returning 404 to user: Volume 1685937f-f379-4fae-bd6d-3995688c4876 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-19f3040e-10f4-4c99-8865-f997083ccc27 tempest-VolumesGetTestJSON-745494093 tempest-VolumesGetTestJSON-745494093-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876" status: 404 len: 109 microversion: 2.1 time: 0.039190 Aug 03 18:58:30.527491 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 387/793] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 18:58:30 2022] GET /compute/v2.1/os-volumes/1685937f-f379-4fae-bd6d-3995688c4876 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:58:45.759780 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:45.760567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:45.764652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7f01bba0-77c9-4c36-9162-4eaf808363ec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:45.767126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7f01bba0-77c9-4c36-9162-4eaf808363ec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:45.774943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7f01bba0-77c9-4c36-9162-4eaf808363ec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:45.775381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7f01bba0-77c9-4c36-9162-4eaf808363ec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:45.776149 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7f01bba0-77c9-4c36-9162-4eaf808363ec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:45.776635 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7f01bba0-77c9-4c36-9162-4eaf808363ec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:45.810837 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7f01bba0-77c9-4c36-9162-4eaf808363ec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052337 Aug 03 18:58:45.811388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 407/794] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 18:58:45 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 18:58:45.871717 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:45.872504 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:58:45.877570 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:45.878165 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:45.885927 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:45.886384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:45.887157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:45.887588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:45.914643 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:58:46.003612 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-05d3fe8a-a783-45cd-a4e8-d56590af4468 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 204 len: 0 microversion: 2.1 time: 0.132959 Aug 03 18:58:46.004449 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 388/795] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:58:45 2022] DELETE /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:58:46.014377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:46.015148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:46.021429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:46.022094 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:46.022878 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:46.023319 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:46.163393 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:46.170966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d326c4e3-4e49-4f78-af6f-04d1e4b3b5e9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1673 microversion: 2.1 time: 0.160535 Aug 03 18:58:46.171657 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 408/796] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:46 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:47.194985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:47.195670 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:47.202134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:47.202593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:47.203497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:47.204756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:47.340044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:47.347932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-94a10059-8dfe-459c-89e2-c153a877e704 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1673 microversion: 2.1 time: 0.157198 Aug 03 18:58:47.348531 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 389/797] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:47 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 18:58:48.370435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:48.371043 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:48.379451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:48.379895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:48.380929 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:48.381515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:48.480883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:48.490036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-53a1c2da-1380-4cb9-a6d8-253f75f8c53b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1606 microversion: 2.1 time: 0.123093 Aug 03 18:58:48.490625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 409/798] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:48 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:48.708888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-9c1b1959-4c30-4200-90d8-1e62ac1c66b0 req-a5f233bb-37c5-4c5b-9c05-6ad72afd2ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800ff343-a07b-438f-9353-240b8ce592a9", "name": "network-vif-deleted", "tag": "c4284c49-f7bf-4ba4-bb52-eab9c9c73389"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:48.722319 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-9c1b1959-4c30-4200-90d8-1e62ac1c66b0 req-a5f233bb-37c5-4c5b-9c05-6ad72afd2ca6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:48.723084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-9c1b1959-4c30-4200-90d8-1e62ac1c66b0 req-a5f233bb-37c5-4c5b-9c05-6ad72afd2ca6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:48.746012 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-9c1b1959-4c30-4200-90d8-1e62ac1c66b0 req-a5f233bb-37c5-4c5b-9c05-6ad72afd2ca6 service nova] Creating event network-vif-deleted:c4284c49-f7bf-4ba4-bb52-eab9c9c73389 for instance 800ff343-a07b-438f-9353-240b8ce592a9 on hv-cinder-85164 Aug 03 18:58:48.763297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-9c1b1959-4c30-4200-90d8-1e62ac1c66b0 req-a5f233bb-37c5-4c5b-9c05-6ad72afd2ca6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059361 Aug 03 18:58:48.763912 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 390/799] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:49.043906 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2035214698"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:49.044570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:49.052459 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:49.053137 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:49.054113 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:49.054733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:49.228079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.network.security_group_api [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Removing security group 60ba659f-87a2-40d5-9c54-b7b0e421076c from port 63b75436-6d6d-448e-9e4b-b87c4d33b454 Aug 03 18:58:49.513109 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:49.513949 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:49.526801 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:49.529154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:49.530192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:49.533923 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:49.587671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:49.588425 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:49.589111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lazy-loading 'fault' on Instance uuid 800ff343-a07b-438f-9353-240b8ce592a9 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:58:49.645356 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:49.654993 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e96f7db9-44ed-4fd0-9f2f-6250fc2628ea tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 200 len: 1328 microversion: 2.1 time: 0.146235 Aug 03 18:58:49.658966 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 391/800] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:49 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 1328 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:49.739957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-434aa24b-21fc-4599-8a69-7c993ab29cc9 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/action" status: 202 len: 0 microversion: 2.1 time: 0.700093 Aug 03 18:58:49.744651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 410/801] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 18:58:49 2022] POST /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:58:50.389414 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 18:58:50.390562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Wed Aug 3 18:58:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 18:58:50.677692 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:50.678633 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:50.685118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:50.685666 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:50.686664 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:50.687183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:50.707492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] HTTP exception thrown: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Request method failure captured: Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 HTTP/1.1 Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN0u66y5EekGZG_aXZFopuwyL4-ZQejKMQlHFyhR5WHjRZ42hgNmCfwqWAXWYgu-FFtFKFUU1e1MlCRVw7u5_G7NwTHXxbcH3l62y6kWxR_y1d-eFYU0ISTAbN7fk98t7lNzAcF7Jc02xD2euwGkHXTq-xkJSk5DLQFx2OQ42Jf794 Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:58:50.709388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77d5ff41add94950b7422c6de3e36257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeTestJSON-517153364 Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeTestJSON-517153364-project Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 13ab977f852a41e898af1ddfb67bad69 Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeTestJSON-517153364-project Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 18:58:50.711079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '800ff343-a07b-438f-9353-240b8ce592a9'} Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:58:50.712075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 18:58:50.713629 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:50.715032 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Returning 404 to user: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:58:50.715032 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-880d7f72-83a1-4e16-8206-1b9be5aafcf6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 404 len: 111 microversion: 2.1 time: 0.038749 Aug 03 18:58:50.723578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-23739cf3-4df0-4506-8e70-fee82bb46caa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '.version_select at 0x7fdaca0613a0>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:50.728947 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 392/802] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:50 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:58:50.753622 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-23739cf3-4df0-4506-8e70-fee82bb46caa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530335597" status: 202 len: 0 microversion: 2.1 time: 0.034756 Aug 03 18:58:50.757908 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 411/803] 10.222.0.69 () {58 vars in 1221 bytes} [Wed Aug 3 18:58:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530335597 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:58:50.785128 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-c2d1f24d-7ec6-40e5-945f-cef5753364e7 req-d630b2c5-b31c-4c89-95b0-5cb9ed2b478a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e36937-1f1d-4b7a-ae8b-df0940da9613", "tag": "63b75436-6d6d-448e-9e4b-b87c4d33b454"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:50.795782 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c2d1f24d-7ec6-40e5-945f-cef5753364e7 req-d630b2c5-b31c-4c89-95b0-5cb9ed2b478a service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:50.796273 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c2d1f24d-7ec6-40e5-945f-cef5753364e7 req-d630b2c5-b31c-4c89-95b0-5cb9ed2b478a service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:50.808737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-c2d1f24d-7ec6-40e5-945f-cef5753364e7 req-d630b2c5-b31c-4c89-95b0-5cb9ed2b478a service nova] Creating event network-changed:63b75436-6d6d-448e-9e4b-b87c4d33b454 for instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 on hv-cinder-85164 Aug 03 18:58:50.815947 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-c2d1f24d-7ec6-40e5-945f-cef5753364e7 req-d630b2c5-b31c-4c89-95b0-5cb9ed2b478a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035177 Aug 03 18:58:50.816815 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 393/804] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:51.473670 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:51.475336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:51.491502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:51.492228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:51.493307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:51.493853 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:51.649378 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lazy-loading 'services' on Instance uuid b9e36937-1f1d-4b7a-ae8b-df0940da9613 {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:58:51.776881 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ebdae8c1-105e-4366-8a1b-5dce1156c89b tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments/4c97bc8d-809d-44b9-9163-6d9e5ceb5b15" status: 202 len: 0 microversion: 2.1 time: 0.308576 Aug 03 18:58:51.780603 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 412/805] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 18:58:51 2022] DELETE /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments/4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:58:51.790038 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-56f3414d-5cc5-41fd-868b-82db0a998fb5 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:51.792304 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-56f3414d-5cc5-41fd-868b-82db0a998fb5 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:51.817555 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-56f3414d-5cc5-41fd-868b-82db0a998fb5 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:51.819898 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-56f3414d-5cc5-41fd-868b-82db0a998fb5 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:51.820900 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-56f3414d-5cc5-41fd-868b-82db0a998fb5 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:51.821539 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-56f3414d-5cc5-41fd-868b-82db0a998fb5 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:51.890330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-56f3414d-5cc5-41fd-868b-82db0a998fb5 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102345 Aug 03 18:58:51.893020 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 394/806] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 18:58:51 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:58:52.103891 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5a1cc52f-e03e-4bc1-a9a5-bd026dbe7075 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'create', calling method: .version_select at 0x7fdac9eeb040>, body: {"keypair": {"name": "tempest-keypair-1200459066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbVyQef88wi4gRdF8UTs/odyuC1GePDpGKnlu1xyUrA8YwdKMzxyscA5AVGnrwgUf8PNVetQyosQHRhPC4M/7QkKSvX/KLvVjy2/STV337fkODDT3BvU30sISNSjPtDVQ=="}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:52.121646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-5a1cc52f-e03e-4bc1-a9a5-bd026dbe7075 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for project 77d5ff41add94950b7422c6de3e36257. Resources: {'key_pairs'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:58:52.126384 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-5a1cc52f-e03e-4bc1-a9a5-bd026dbe7075 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for user 13ab977f852a41e898af1ddfb67bad69 and project 77d5ff41add94950b7422c6de3e36257. Resources: {'key_pairs'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:58:52.152549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5a1cc52f-e03e-4bc1-a9a5-bd026dbe7075 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051800 Aug 03 18:58:52.152549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 413/807] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 18:58:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:52.837796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-0bd0dd85-3ba1-47bf-993c-26f1a15eacd1 req-7b760078-b56f-4bcf-b6ca-2881bedb1efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e36937-1f1d-4b7a-ae8b-df0940da9613", "tag": "63b75436-6d6d-448e-9e4b-b87c4d33b454"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:52.854490 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-0bd0dd85-3ba1-47bf-993c-26f1a15eacd1 req-7b760078-b56f-4bcf-b6ca-2881bedb1efe service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:52.855355 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-0bd0dd85-3ba1-47bf-993c-26f1a15eacd1 req-7b760078-b56f-4bcf-b6ca-2881bedb1efe service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:52.873954 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-0bd0dd85-3ba1-47bf-993c-26f1a15eacd1 req-7b760078-b56f-4bcf-b6ca-2881bedb1efe service nova] Creating event network-changed:63b75436-6d6d-448e-9e4b-b87c4d33b454 for instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 on hv-cinder-85164 Aug 03 18:58:52.881039 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-0bd0dd85-3ba1-47bf-993c-26f1a15eacd1 req-7b760078-b56f-4bcf-b6ca-2881bedb1efe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050399 Aug 03 18:58:52.881791 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 395/808] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:52.905421 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-37aef6eb-6411-4c2f-9e7a-428618c7815c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:52.909324 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-37aef6eb-6411-4c2f-9e7a-428618c7815c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:52.924230 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37aef6eb-6411-4c2f-9e7a-428618c7815c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:52.924713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37aef6eb-6411-4c2f-9e7a-428618c7815c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:52.925698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37aef6eb-6411-4c2f-9e7a-428618c7815c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:52.926494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37aef6eb-6411-4c2f-9e7a-428618c7815c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:52.963497 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-37aef6eb-6411-4c2f-9e7a-428618c7815c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063007 Aug 03 18:58:52.964390 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 414/809] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 18:58:52 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 18:58:52.976241 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:52.976989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:52.983249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:52.983841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:52.985496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:52.986018 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:53.075935 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] HTTP exception thrown: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 is not attached to volume 4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Request method failure captured: Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments/4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 HTTP/1.1 Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sRd9gU_gfNeOW4_dzwHsaYsK0LFXV0xhaKyAzKzLtjidf2iazy-KyUmV4875wbsjIBBJZXQv3Ut6XOoIBAHIjQA38VtPJZ7Qkzs59-ofasKzgn-3ELJYSBc-XWUAXOL1uX1yOOE1XJ_4Mwr7VTvwl1lxzcVgnFGmDTRlKwlYJlFSUc Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 182c4b8842bb4aa1a31fbd603c52b276 Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-TestMinimumBasicScenario-458153823 Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 18:58:53.079773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-TestMinimumBasicScenario-458153823 Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 182c4b8842bb4aa1a31fbd603c52b276 Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-TestMinimumBasicScenario-458153823 Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-TestMinimumBasicScenario-458153823-project Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: effc38ce5cd6441b92ed3bbb2eaee76c Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-TestMinimumBasicScenario-458153823-project Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 18:58:53.081447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 is not attached to volume 4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'server_id': 'b9e36937-1f1d-4b7a-ae8b-df0940da9613', 'id': '4c97bc8d-809d-44b9-9163-6d9e5ceb5b15'} Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4c97bc8d-809d-44b9-9163-6d9e5ceb5b15. Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:58:53.082429 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 is not attached to volume 4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 is not attached to volume 4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 Aug 03 18:58:53.083932 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 18:58:53.085761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Returning 404 to user: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 is not attached to volume 4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:58:53.086825 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d4f7260d-b669-4ac3-b888-f7c84150c5da tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments/4c97bc8d-809d-44b9-9163-6d9e5ceb5b15" status: 404 len: 154 microversion: 2.1 time: 0.115077 Aug 03 18:58:53.087572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 396/810] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 18:58:52 2022] DELETE /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613/os-volume_attachments/4c97bc8d-809d-44b9-9163-6d9e5ceb5b15 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 18:58:54.141672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-151217622", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "701843e1-2e94-48b3-9b51-56f740f224e4"}], "security_groups": [{"name": "tempest-securitygroup--1924586738"}], "key_name": "tempest-keypair-1200459066", "user_data": "}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:54.244586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:54.245179 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:54.253413 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:54.254103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:54.255075 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:54.255523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:54.260240 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] validate_networks() for [('701843e1-2e94-48b3-9b51-56f740f224e4', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 18:58:54.282934 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 18:58:54.370425 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f5d4663d-bd6a-42e2-89d9-a1c61d1218d3 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 204 len: 0 microversion: 2.1 time: 0.129439 Aug 03 18:58:54.371008 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 397/811] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 18:58:54 2022] DELETE /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:58:54.380400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:54.381110 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:54.387004 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:54.387462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:54.388233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:54.388908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:54.622347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:54.631340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7aeddd5e-b595-4aee-8fc0-431ca23ec677 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1555 microversion: 2.1 time: 0.255443 Aug 03 18:58:54.632022 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 398/812] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:54 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:54.759016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 18:58:54.759449 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 18:58:54.759926 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 18:58:54.760371 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 18:58:54.760792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 18:58:54.770595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:54.771044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:54.772024 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:54.772508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:54.802432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for project 77d5ff41add94950b7422c6de3e36257. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 18:58:54.808713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Getting quotas for user 13ab977f852a41e898af1ddfb67bad69 and project 77d5ff41add94950b7422c6de3e36257. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 18:58:54.826241 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 18:58:54.829748 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 18:58:54.879568 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c055e7d5-3f04-43ec-90c6-d0729c39f8e6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.743252 Aug 03 18:58:54.880567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 415/813] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 18:58:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 18:58:54.892145 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-48fd93a1-f5fb-47bf-b29f-211fadcfbf35 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:54.893220 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-48fd93a1-f5fb-47bf-b29f-211fadcfbf35 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:54.970350 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-48fd93a1-f5fb-47bf-b29f-211fadcfbf35 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:54.977029 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-48fd93a1-f5fb-47bf-b29f-211fadcfbf35 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1237 microversion: 2.1 time: 0.089594 Aug 03 18:58:54.980736 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 399/814] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:54 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:55.654539 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:55.655234 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:55.663283 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:55.663739 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:55.664536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:55.665003 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:55.800226 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:55.807606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c6be2b03-af6f-4fe9-9f10-05f0f8e7104e tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1555 microversion: 2.1 time: 0.156964 Aug 03 18:58:55.808179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 416/815] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:55 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:55.997858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:55.998480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:56.006205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:56.006660 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:56.007446 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:56.007891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:56.073683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:56.082950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e00c1603-458e-4973-9f86-aab1d5240680 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1233 microversion: 2.1 time: 0.088859 Aug 03 18:58:56.083528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 400/816] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:55 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:56.830789 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:56.831571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:56.838508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:56.839216 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:56.840166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:56.840634 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:57.073560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:57.092397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-23ef50d5-e171-439b-95ae-04c0ee3528cc tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1555 microversion: 2.1 time: 0.266123 Aug 03 18:58:57.098680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 417/817] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:56 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:57.114204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:57.115547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:57.123223 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:57.123575 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:57.124372 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:57.125070 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:57.219044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:57.229493 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2d59bfdf-6e62-40cb-9569-84983a707902 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1295 microversion: 2.1 time: 0.123448 Aug 03 18:58:57.230764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 401/818] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:57 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:57.519085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-cd49e629-be2e-48a8-8a31-7d1779f52732 req-d1880a75-430a-433a-b2ff-cfec8093613f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e36937-1f1d-4b7a-ae8b-df0940da9613", "name": "network-vif-deleted", "tag": "63b75436-6d6d-448e-9e4b-b87c4d33b454"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:57.532706 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-cd49e629-be2e-48a8-8a31-7d1779f52732 req-d1880a75-430a-433a-b2ff-cfec8093613f service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:57.533552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-cd49e629-be2e-48a8-8a31-7d1779f52732 req-d1880a75-430a-433a-b2ff-cfec8093613f service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:57.545966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-cd49e629-be2e-48a8-8a31-7d1779f52732 req-d1880a75-430a-433a-b2ff-cfec8093613f service nova] Creating event network-vif-deleted:63b75436-6d6d-448e-9e4b-b87c4d33b454 for instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 on hv-cinder-85164 Aug 03 18:58:57.552426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-cd49e629-be2e-48a8-8a31-7d1779f52732 req-d1880a75-430a-433a-b2ff-cfec8093613f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037780 Aug 03 18:58:57.553307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 418/819] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:58:58.118598 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:58.120087 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:58.129520 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:58.130473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:58.131607 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:58.132224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:58.169085 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:58.169453 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:58.169908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lazy-loading 'fault' on Instance uuid b9e36937-1f1d-4b7a-ae8b-df0940da9613 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:58:58.217823 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effc38ce5cd6441b92ed3bbb2eaee76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182c4b8842bb4aa1a31fbd603c52b276', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:58.225377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2903e7c5-1888-44e2-93d4-f6118d55f897 tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 200 len: 1349 microversion: 2.1 time: 0.111782 Aug 03 18:58:58.225965 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 402/820] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:58 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 1349 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:58.259126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:58.259935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:58.267004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:58.267576 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:58.268543 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:58.269069 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:58.416046 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:58.424874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fa1011cd-d572-4266-a536-ed13cfb67a2a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1363 microversion: 2.1 time: 0.170186 Aug 03 18:58:58.425516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 419/821] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:58 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:58:58.642975 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-9e3e9da3-a4e8-4a50-b84e-f7db823de16b req-bd3717da-f997-420c-990f-ebd9d6644a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0364838-7777-408c-be7a-8b9de8091665", "tag": "e409a276-c19a-4d7d-949e-4938908a8eba"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:58:58.654825 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-9e3e9da3-a4e8-4a50-b84e-f7db823de16b req-bd3717da-f997-420c-990f-ebd9d6644a11 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:58.656062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-9e3e9da3-a4e8-4a50-b84e-f7db823de16b req-bd3717da-f997-420c-990f-ebd9d6644a11 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:58.669545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-9e3e9da3-a4e8-4a50-b84e-f7db823de16b req-bd3717da-f997-420c-990f-ebd9d6644a11 service nova] Creating event network-changed:e409a276-c19a-4d7d-949e-4938908a8eba for instance c0364838-7777-408c-be7a-8b9de8091665 on hv-cinder-85164 Aug 03 18:58:58.677161 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-9e3e9da3-a4e8-4a50-b84e-f7db823de16b req-bd3717da-f997-420c-990f-ebd9d6644a11 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038541 Aug 03 18:58:58.678374 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 403/822] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 18:58:59.308736 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:59.309362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] [instance: b9e36937-1f1d-4b7a-ae8b-df0940da9613] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:59.317009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:59.317466 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:59.318252 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:59.318698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:59.333943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] HTTP exception thrown: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 could not be found. Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Request method failure captured: Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 HTTP/1.1 Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sRd9gU_gfNeOW4_dzwHsaYsK0LFXV0xhaKyAzKzLtjidf2iazy-KyUmV4875wbsjIBBJZXQv3Ut6XOoIBAHIjQA38VtPJZ7Qkzs59-ofasKzgn-3ELJYSBc-XWUAXOL1uX1yOOE1XJ_4Mwr7VTvwl1lxzcVgnFGmDTRlKwlYJlFSUc Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 182c4b8842bb4aa1a31fbd603c52b276 Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-TestMinimumBasicScenario-458153823 Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 18:58:59.335647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/182c4b8842bb4aa1a31fbd603c52b276"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-TestMinimumBasicScenario-458153823 Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 182c4b8842bb4aa1a31fbd603c52b276 Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-TestMinimumBasicScenario-458153823 Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-TestMinimumBasicScenario-458153823-project Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: effc38ce5cd6441b92ed3bbb2eaee76c Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-TestMinimumBasicScenario-458153823-project Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 could not be found. Aug 03 18:58:59.337301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'b9e36937-1f1d-4b7a-ae8b-df0940da9613'} Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 could not be found. Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 18:58:59.338552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 could not be found. Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 could not be found. Aug 03 18:58:59.339997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 18:58:59.342058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Returning 404 to user: Instance b9e36937-1f1d-4b7a-ae8b-df0940da9613 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 18:58:59.342058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-fd76133a-2888-4b14-89f8-b53b50b8677c tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613" status: 404 len: 111 microversion: 2.1 time: 0.032421 Aug 03 18:58:59.342058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 420/823] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:59 2022] GET /compute/v2.1/servers/b9e36937-1f1d-4b7a-ae8b-df0940da9613 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 18:58:59.348772 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0774888e-0d43-4035-a0bc-1b9710f986ec tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] Calling method '.version_select at 0x7fdac9ea51f0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:59.370973 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0774888e-0d43-4035-a0bc-1b9710f986ec tempest-TestMinimumBasicScenario-458153823 tempest-TestMinimumBasicScenario-458153823-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1325982020" status: 202 len: 0 microversion: 2.1 time: 0.028203 Aug 03 18:58:59.371552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 404/824] 10.222.0.69 () {58 vars in 1272 bytes} [Wed Aug 3 18:58:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1325982020 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 18:58:59.445566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:58:59.446404 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:58:59.452912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:59.453372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:59.454152 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:58:59.454685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:58:59.600032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:58:59.607531 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-88371c62-c18b-41d3-82a6-2dfe50963f5b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1363 microversion: 2.1 time: 0.165825 Aug 03 18:58:59.608098 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 421/825] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:58:59 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:59:00.630367 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:00.631227 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:00.638772 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:00.639216 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:00.639977 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:00.640467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:00.773718 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:00.777218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:00.782224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2e4a2a61-9036-49e1-aa8b-bcfbb1462fec tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1363 microversion: 2.1 time: 0.157545 Aug 03 18:59:00.782797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 405/826] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:59:00 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:59:01.805369 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:01.807791 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:01.819905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:01.820672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:01.821638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:01.822630 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:02.059584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:02.082508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2a2b6758-4b8a-4474-be27-7665e6caa92a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1363 microversion: 2.1 time: 0.281245 Aug 03 18:59:02.095905 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 422/827] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:59:01 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:59:03.103816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:03.107744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:03.118260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:03.118917 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:03.120011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:03.121230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:03.349908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:03.358647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-82c47b7b-2889-4637-b085-6befd32b67a9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1363 microversion: 2.1 time: 0.259145 Aug 03 18:59:03.373527 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 406/828] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:59:03 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:59:04.383044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:04.383762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:04.390132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:04.391266 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:04.392048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:04.392695 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:04.591338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:04.601646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7a4bf79d-2398-49e0-9d5e-f555dd136cfd tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1363 microversion: 2.1 time: 0.222430 Aug 03 18:59:04.602851 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 423/829] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:59:04 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:59:04.696125 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-640f9050-8083-47d9-9491-d05fe0ee5297 req-4f174448-b072-45c2-82a8-54dd25e14d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0364838-7777-408c-be7a-8b9de8091665", "name": "network-vif-plugged", "status": "completed", "tag": "e409a276-c19a-4d7d-949e-4938908a8eba"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:59:04.712500 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-640f9050-8083-47d9-9491-d05fe0ee5297 req-4f174448-b072-45c2-82a8-54dd25e14d17 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:04.713269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-640f9050-8083-47d9-9491-d05fe0ee5297 req-4f174448-b072-45c2-82a8-54dd25e14d17 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:04.731308 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-640f9050-8083-47d9-9491-d05fe0ee5297 req-4f174448-b072-45c2-82a8-54dd25e14d17 service nova] Creating event network-vif-plugged:e409a276-c19a-4d7d-949e-4938908a8eba for instance c0364838-7777-408c-be7a-8b9de8091665 on hv-cinder-85164 Aug 03 18:59:04.739574 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-640f9050-8083-47d9-9491-d05fe0ee5297 req-4f174448-b072-45c2-82a8-54dd25e14d17 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051269 Aug 03 18:59:04.740807 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 407/830] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:59:05.631641 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:05.632273 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:05.636004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:05.637391 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=10 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:05.644706 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:05.645637 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:05.646493 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:05.647139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:06.193260 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:06.200898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2b172e19-d13a-4254-a209-6be2062736a6 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1363 microversion: 2.1 time: 0.574225 Aug 03 18:59:06.201724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 424/831] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:59:05 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1363 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:59:07.219100 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:07.224438 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:07.225331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:07.233605 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:07.234317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:07.235253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:07.235850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:07.497179 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:07.505974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ec7cdb80-d4db-48cf-a4ee-27ba8a5ea5d2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1548 microversion: 2.1 time: 0.287586 Aug 03 18:59:07.507192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 408/832] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 18:59:07 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1548 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 18:59:07.528099 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ec6d5aff-8014-4796-8e4e-4a91e4dbc63f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:07.528625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ec6d5aff-8014-4796-8e4e-4a91e4dbc63f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:07.536185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec6d5aff-8014-4796-8e4e-4a91e4dbc63f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:07.536714 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec6d5aff-8014-4796-8e4e-4a91e4dbc63f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:07.537495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec6d5aff-8014-4796-8e4e-4a91e4dbc63f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:07.537928 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ec6d5aff-8014-4796-8e4e-4a91e4dbc63f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:07.628975 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ec6d5aff-8014-4796-8e4e-4a91e4dbc63f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104590 Aug 03 18:59:07.630256 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 425/833] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 18:59:07 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:59:08.986808 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-9b350114-2135-4f47-98c8-1ecb7a6b01d4 req-c51bda45-4f83-4212-b714-7ed1366e8579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0364838-7777-408c-be7a-8b9de8091665", "tag": "e409a276-c19a-4d7d-949e-4938908a8eba"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:59:08.992586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-9b350114-2135-4f47-98c8-1ecb7a6b01d4 req-c51bda45-4f83-4212-b714-7ed1366e8579 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:08.993048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-9b350114-2135-4f47-98c8-1ecb7a6b01d4 req-c51bda45-4f83-4212-b714-7ed1366e8579 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:09.008020 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-9b350114-2135-4f47-98c8-1ecb7a6b01d4 req-c51bda45-4f83-4212-b714-7ed1366e8579 service nova] Creating event network-changed:e409a276-c19a-4d7d-949e-4938908a8eba for instance c0364838-7777-408c-be7a-8b9de8091665 on hv-cinder-85164 Aug 03 18:59:09.019813 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-9b350114-2135-4f47-98c8-1ecb7a6b01d4 req-c51bda45-4f83-4212-b714-7ed1366e8579 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041470 Aug 03 18:59:09.021351 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 409/834] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 18:59:37.837213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:37.837980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:37.842820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-71fd2298-a01c-4efc-9809-f91ded7ab83e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:37.843323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-71fd2298-a01c-4efc-9809-f91ded7ab83e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:37.853345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71fd2298-a01c-4efc-9809-f91ded7ab83e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:37.853793 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71fd2298-a01c-4efc-9809-f91ded7ab83e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:37.855006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71fd2298-a01c-4efc-9809-f91ded7ab83e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:37.855006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71fd2298-a01c-4efc-9809-f91ded7ab83e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:37.882636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-71fd2298-a01c-4efc-9809-f91ded7ab83e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/ips" status: 200 len: 151 microversion: 2.20 time: 0.046977 Aug 03 18:59:37.883206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 426/835] 10.222.0.69 () {60 vars in 1289 bytes} [Wed Aug 3 18:59:37 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 18:59:39.706103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:39.706854 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=16 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 18:59:39.711851 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:59:39.712498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:39.719977 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:39.720449 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:39.721213 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:39.721642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:39.747055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lazy-loading 'flavor' on Instance uuid b197c2f4-4c3c-44a2-a777-6ac04cddbb4d {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 18:59:39.928989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c25d6fdd-dd8c-4d4d-9990-d99b8af377eb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/action" status: 202 len: 0 microversion: 2.20 time: 0.224040 Aug 03 18:59:39.929592 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 410/836] 10.222.0.69 () {62 vars in 1319 bytes} [Wed Aug 3 18:59:39 2022] POST /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 18:59:39.938261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:39.938933 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:39.946433 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:39.946952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:39.947827 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:39.948400 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:40.079672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:40.088230 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:40.089778 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:40.090942 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-55e47d0b-63eb-4a13-accc-29f66d0998fe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.156709 Aug 03 18:59:40.091501 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 427/837] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:39 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:41.116525 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:41.117232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:41.124376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:41.124854 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:41.125889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:41.126355 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:41.271982 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:41.279987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:41.281608 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:41.282752 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2da85eea-7212-4ad2-bf36-1fc6cfb5967a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.172006 Aug 03 18:59:41.283379 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 411/838] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:41 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:42.307439 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:42.308109 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:42.314692 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:42.315146 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:42.315913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:42.316382 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:42.450957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:42.459058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:42.460605 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:42.461778 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5c3b23e1-65ff-4374-9dda-a08b3a647089 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.158239 Aug 03 18:59:42.462342 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 428/839] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:42 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:43.485323 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:43.485805 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:43.492763 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:43.493219 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:43.493998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:43.494444 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:43.637297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:43.647735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:43.649488 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:43.651030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-029c4add-145c-4822-ad0b-488868860796 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.170205 Aug 03 18:59:43.651627 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 412/840] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:43 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:44.676184 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:44.676917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:44.684494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:44.685030 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:44.685882 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:44.686388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:44.834903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:44.842998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:44.844534 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:44.845693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c2d71ad1-4b02-4846-b22f-5ba302775a3a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.174598 Aug 03 18:59:44.848318 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 429/841] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:44 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:45.870969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:45.872116 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:45.879268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:45.879734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:45.880683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:45.881146 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:46.017901 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:46.026965 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:46.028530 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:46.030142 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5923194b-ecb7-4aab-bff5-f97a6e78c2fc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.162991 Aug 03 18:59:46.030269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 413/842] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:45 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:47.053854 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:47.054464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:47.060985 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:47.061443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:47.062215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:47.062652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:47.201642 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:47.210459 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:47.211966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:47.213166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ed069b52-9c70-4810-be33-91ebb9fb9141 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.163782 Aug 03 18:59:47.213732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 430/843] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:47 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:48.236692 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:48.237354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:48.244386 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:48.244837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:48.245603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:48.246058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:48.389148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:48.397913 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:48.399438 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:48.400747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cc2776cd-e5d6-46cd-974b-1b70df392067 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.167812 Aug 03 18:59:48.401320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 414/844] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:48 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:49.424188 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:49.424845 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:49.432389 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:49.432847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:49.433617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:49.434065 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:49.564778 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:49.573273 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:49.574791 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:49.576206 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5ff7a367-3639-4891-8379-338d76132750 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.155891 Aug 03 18:59:49.576709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 431/845] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:49 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:50.598972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:50.599587 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:50.606784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:50.607233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:50.607996 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:50.608563 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:50.743652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:50.751739 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:50.753285 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:50.754434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-55012dce-d4af-43f1-8733-482c829a1071 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.159411 Aug 03 18:59:50.754987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 415/846] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:50 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:51.779036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:51.779992 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:51.789831 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:51.790519 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:51.791587 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:51.792360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:51.934233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:51.943190 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:51.944761 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:51.945940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7143c215-cec2-40f7-89be-0b8ebef6ee2d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.172126 Aug 03 18:59:51.946578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 432/847] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:51 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:52.969466 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:52.970008 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:52.977779 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:52.978231 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:52.978999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:52.979440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:53.112190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:53.120376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:53.121972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:53.123217 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ddcd9ff4-a437-4fd9-b45f-8c5bc2eb348e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.157828 Aug 03 18:59:53.123784 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 416/848] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:52 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:54.152054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:54.152715 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:54.160112 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:54.160584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:54.162130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:54.162941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:54.298615 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:54.306666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:54.308182 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:54.309374 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7521ec34-2c6f-4642-bc33-ffcbdb852bb5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.165704 Aug 03 18:59:54.309930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 433/849] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:54 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:55.332366 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:55.332976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:55.339558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:55.340001 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:55.340788 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:55.341249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:55.476963 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:55.484897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:55.486400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:55.487548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b5c3ac71-a71a-42c9-aee4-c56e3d8cb361 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.159189 Aug 03 18:59:55.488114 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 417/850] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:55 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:56.512083 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:56.512712 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:56.519281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:56.519729 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:56.520532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:56.520971 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:56.660025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:56.668187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:56.669847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:56.671031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8b5663b1-8539-4549-9e4b-805fab6a8676 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.162882 Aug 03 18:59:56.671589 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 434/851] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:56 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:57.695287 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:57.696043 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:57.703028 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:57.703492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:57.704344 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:57.704793 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:57.838465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:57.846650 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:57.848151 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:57.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7cef455b-fc70-449c-beea-bcc2d9923337 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.158978 Aug 03 18:59:57.849907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 418/852] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:57 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 18:59:58.873179 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 18:59:58.873787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 18:59:58.880570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:58.881021 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:58.881780 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:58.882225 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:59.015603 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:59.024379 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:59.025847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 18:59:59.026999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-852475da-09f2-49be-9c4e-66ef8e56e56d tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.157730 Aug 03 18:59:59.027556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 435/853] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 18:59:58 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 18:59:59.936449 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-64893484-78f0-45b4-8aad-ec77664709fb req-a2532275-c3b0-4113-aeb9-b6442e99f6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b197c2f4-4c3c-44a2-a777-6ac04cddbb4d", "name": "network-vif-plugged", "status": "completed", "tag": "3c6f8293-ee04-4b19-94b1-87cab0643fb5"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 18:59:59.949376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-64893484-78f0-45b4-8aad-ec77664709fb req-a2532275-c3b0-4113-aeb9-b6442e99f6b9 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 18:59:59.949835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-64893484-78f0-45b4-8aad-ec77664709fb req-a2532275-c3b0-4113-aeb9-b6442e99f6b9 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 18:59:59.961540 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-64893484-78f0-45b4-8aad-ec77664709fb req-a2532275-c3b0-4113-aeb9-b6442e99f6b9 service nova] Creating event network-vif-plugged:3c6f8293-ee04-4b19-94b1-87cab0643fb5 for instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d on hv-cinder-85164 Aug 03 18:59:59.966616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-64893484-78f0-45b4-8aad-ec77664709fb req-a2532275-c3b0-4113-aeb9-b6442e99f6b9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034223 Aug 03 18:59:59.967361 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 419/854] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 18:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:00:00.049191 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:00.049724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:00.057479 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:00.058102 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:00.058915 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:00.059430 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:00.190153 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:00.198070 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:00.199564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:00.200779 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-09362031-4698-4770-9534-2868d0b61fc1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.155601 Aug 03 19:00:00.201318 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 436/855] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:00 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:01.223508 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:01.224201 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:01.231416 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:01.231908 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:01.232743 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:01.233183 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:01.385665 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:01.394529 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:01.396585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:01.398921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d3f54286-1d91-4ef0-aeed-68d7446da1ad tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1744 microversion: 2.20 time: 0.179134 Aug 03 19:00:01.399357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 420/856] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:01 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:02.453606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:02.454355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:02.464957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:02.465713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:02.467002 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:02.467778 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:02.654864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:02.664750 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:02.667737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:02.669267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-53f2c9cc-ee56-467f-892e-1fbe81256a09 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.250232 Aug 03 19:00:02.670033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 437/857] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:02 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:03.695242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:03.698294 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:03.706176 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:03.707058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:03.708334 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:03.708946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:03.880748 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:03.891542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:03.893398 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:03.894745 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9b418e59-58e1-498e-a19c-45a7939168f7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.204745 Aug 03 19:00:03.895386 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 421/858] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:03 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:04.918756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:04.920064 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:04.927198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:04.927760 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:04.928741 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:04.930212 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:05.123628 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:05.135811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:05.138105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:05.139588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1515c579-4e3f-4eca-978e-7d7647103d84 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.225177 Aug 03 19:00:05.140634 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 438/859] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:04 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:06.165582 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:06.167288 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:06.174393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:06.174852 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:06.175631 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:06.176090 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:06.339559 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:06.349083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:06.352078 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:06.353749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fd80c789-d128-4bf5-8a23-f4f8bb8eece5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.192457 Aug 03 19:00:06.354623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 422/860] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:06 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:07.383349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:07.383969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:07.392204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:07.392688 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:07.393679 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:07.394121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:07.563985 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:07.572535 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:07.574051 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:07.575226 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9758a2fb-ad75-4248-8f2c-d0b1c2c77256 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.196617 Aug 03 19:00:07.575954 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 439/861] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:07 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:08.599859 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:08.600773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:08.608593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:08.609167 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:08.610060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:08.610568 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:08.764896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:08.774611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:08.776145 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:08.777417 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-32483b02-4578-41df-b174-d6bb230bdabf tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.182734 Aug 03 19:00:08.778124 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 423/862] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:08 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:09.805994 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:09.806750 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:09.808838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=29 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:09.814656 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:09.815358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:09.816139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:09.816643 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:09.819404 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=83 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:09.957459 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:09.967986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:09.969563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:09.971076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8eb06ba5-d56d-4429-b04f-9b8ad8a51d38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.173598 Aug 03 19:00:09.978084 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 440/863] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:09 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:10.994272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:10.994866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:10.997648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=29 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:11.003275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:11.003720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:11.004528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:11.004963 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:11.008804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:11.159111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:11.168351 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:11.169882 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:11.171050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5b333928-ff3f-4d64-a751-b1a5db305ae1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.181290 Aug 03 19:00:11.172337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 424/864] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:10 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:00:12.195501 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:12.196194 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:12.206348 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:12.207049 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:12.208105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:12.208686 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:12.363919 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:12.373176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:12.376368 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:12.377732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-65ae73ae-1d1f-4062-a8d4-e0a935cfde6e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.186604 Aug 03 19:00:12.378185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 441/865] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:12 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:13.409263 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:13.409798 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:13.416969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:13.417448 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:13.418213 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:13.418647 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:13.556621 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:13.564580 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:13.566094 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:13.567253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7c92224f-a378-4294-97e4-cf7a3854f1c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1739 microversion: 2.20 time: 0.161971 Aug 03 19:00:13.567819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 425/866] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:13 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:14.591284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:14.591884 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:14.598594 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:14.599079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:14.599854 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:14.600330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:14.921836 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:14.930487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:14.932014 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:14.933232 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0dd11f3b-7d34-4f7a-b76e-2809a3987afe tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1721 microversion: 2.20 time: 0.346437 Aug 03 19:00:14.933797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 442/867] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:14 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1721 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:15.956345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:15.956963 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:15.963539 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:15.963988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:15.964793 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:15.965230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:16.157804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:16.166521 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:16.168150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:16.169452 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8c9c2be4-1f1b-4e05-ae14-193e18bb5e37 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1721 microversion: 2.20 time: 0.217261 Aug 03 19:00:16.170103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 426/868] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:15 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:17.193180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:17.193834 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:17.201182 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:17.202266 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:17.203052 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:17.203496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:17.340456 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:17.348517 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:17.350032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:17.351194 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d0fe5096-01f3-479d-bcdf-4da9def6fd8e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1664 microversion: 2.20 time: 0.161985 Aug 03 19:00:17.351759 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 443/869] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:17 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1664 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:17.373952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0ed93494-4333-49ab-afe2-147ea3a8c70e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "421335cb-4d34-4cbf-bbe2-ce9d98f4e064"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:00:17.376535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0ed93494-4333-49ab-afe2-147ea3a8c70e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:17.382857 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0ed93494-4333-49ab-afe2-147ea3a8c70e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:17.383583 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0ed93494-4333-49ab-afe2-147ea3a8c70e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:17.384410 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0ed93494-4333-49ab-afe2-147ea3a8c70e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:17.384857 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0ed93494-4333-49ab-afe2-147ea3a8c70e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:17.656550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0ed93494-4333-49ab-afe2-147ea3a8c70e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286170 Aug 03 19:00:17.657157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 427/870] 10.222.0.69 () {62 vars in 1364 bytes} [Wed Aug 3 19:00:17 2022] POST /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 19:00:17.787072 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-02c7629f-3c8d-47f6-8ed1-0b5eea1707f9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:17.787570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-02c7629f-3c8d-47f6-8ed1-0b5eea1707f9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:17.793712 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-02c7629f-3c8d-47f6-8ed1-0b5eea1707f9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:17.794166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-02c7629f-3c8d-47f6-8ed1-0b5eea1707f9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:17.794928 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-02c7629f-3c8d-47f6-8ed1-0b5eea1707f9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:17.795370 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-02c7629f-3c8d-47f6-8ed1-0b5eea1707f9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:18.017094 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-865afdd2-9843-40eb-8936-ffa6bab84535 req-e918e48e-b5f5-4d33-8650-3792d929ebce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b197c2f4-4c3c-44a2-a777-6ac04cddbb4d", "name": "network-vif-unplugged", "status": "completed", "tag": "3c6f8293-ee04-4b19-94b1-87cab0643fb5"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:00:18.029463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-865afdd2-9843-40eb-8936-ffa6bab84535 req-e918e48e-b5f5-4d33-8650-3792d929ebce service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:18.030072 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-865afdd2-9843-40eb-8936-ffa6bab84535 req-e918e48e-b5f5-4d33-8650-3792d929ebce service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:18.042976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.compute.server_external_events [req-865afdd2-9843-40eb-8936-ffa6bab84535 req-e918e48e-b5f5-4d33-8650-3792d929ebce service nova] Unable to find a host for instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d. Dropping event network-vif-unplugged {{(pid=129368) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 03 19:00:18.043953 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-865afdd2-9843-40eb-8936-ffa6bab84535 req-e918e48e-b5f5-4d33-8650-3792d929ebce service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031239 Aug 03 19:00:18.044593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 428/871] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 03 19:00:18.061359 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-02c7629f-3c8d-47f6-8ed1-0b5eea1707f9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-volume_attachments/421335cb-4d34-4cbf-bbe2-ce9d98f4e064" status: 202 len: 0 microversion: 2.20 time: 0.277801 Aug 03 19:00:18.061968 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 444/872] 10.222.0.69 () {60 vars in 1457 bytes} [Wed Aug 3 19:00:17 2022] DELETE /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-volume_attachments/421335cb-4d34-4cbf-bbe2-ce9d98f4e064 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:00:18.124956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:00:18.125803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:18.131838 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:18.132302 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:18.133105 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:18.134839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:18.166925 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129368) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 19:00:18.235188 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-880954a7-f7b5-4ada-bed3-5b2d0f4f4388 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "POST /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/action" status: 202 len: 0 microversion: 2.20 time: 0.114262 Aug 03 19:00:18.235797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 429/873] 10.222.0.69 () {62 vars in 1319 bytes} [Wed Aug 3 19:00:18 2022] POST /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:00:18.244516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:18.245151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:18.252607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:18.253065 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:18.253843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:18.254284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:18.395468 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:18.403978 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:18.405690 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:18.406895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a37801e7-70da-41ab-b9be-2ee12120e9cc tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1672 microversion: 2.20 time: 0.166791 Aug 03 19:00:18.407465 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 445/874] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:18 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:19.430635 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:19.431181 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:19.437327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:19.437780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:19.438553 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:19.439016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:19.574803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:19.584106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:19.585659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:19.587495 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d5f3cb04-2ed0-481d-8ced-0402cd5f51b2 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.161796 Aug 03 19:00:19.588055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 430/875] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:19 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:00:20.611451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:20.612069 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:20.619765 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:20.620218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:20.621021 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:20.621453 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:20.779944 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:20.794405 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:20.800044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:20.804103 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ce6c05d1-c7f0-4cf5-8920-9a47710e769e tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.195966 Aug 03 19:00:20.829216 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 446/876] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:20 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:21.837481 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:21.838521 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:21.846862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:21.847738 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:21.848853 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:21.849314 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:22.005492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:22.014914 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:22.016458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:22.017625 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6aaba5b6-a42e-4ddf-913c-b786c7ce8074 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.184866 Aug 03 19:00:22.018192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 431/877] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:21 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:23.041566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:23.042676 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:23.050620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:23.051164 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:23.052015 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:23.052552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:23.199176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:23.209947 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:23.211792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:23.213738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-47d02b93-fa5b-4f5e-a17f-588755e7be06 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.176425 Aug 03 19:00:23.214733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 447/878] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:23 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:24.239590 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:24.240255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:24.247866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:24.248344 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:24.249129 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:24.249567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:24.404523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:24.413348 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:24.414941 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:24.416117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c7116422-177b-475d-be4f-638b87a3c80a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.180440 Aug 03 19:00:24.416857 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 432/879] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:24 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:25.442328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:25.443082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:25.451199 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:25.451633 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:25.452441 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:25.452882 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:25.607403 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:25.616235 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:25.618650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:25.620573 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3cb3bf03-71e3-414b-ae5d-45e58e06ed95 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.182387 Aug 03 19:00:25.621187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 448/880] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:25 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:26.645959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:26.646603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:26.654232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:26.654710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:26.655473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:26.655911 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:26.799574 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:26.807847 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:26.809378 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:26.810697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5a4eefc1-a3ed-49a3-9891-0f69e3698912 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.168699 Aug 03 19:00:26.811281 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 433/881] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:26 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:27.835213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:27.835987 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:27.844830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:27.845147 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:27.845941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:27.846381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:28.005167 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:28.015536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:28.017155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:28.018343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-46f9e110-3aa9-4f94-b591-2579a5eb1ddb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.187223 Aug 03 19:00:28.019088 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 449/882] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:27 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:29.044257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:29.045468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:29.053108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:29.053599 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:29.054419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:29.054891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:29.189177 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:29.197620 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:29.199137 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:29.200311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-236eb481-3b83-491d-8e1e-b4f5b067b266 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.161249 Aug 03 19:00:29.201064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 434/883] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:29 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:30.223059 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:30.223680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:30.231296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:30.231737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:30.232526 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:30.232978 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:30.379631 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:30.388239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:30.389894 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:30.390925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8f549f22-197f-48f3-8af4-d00f956fa7f1 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.171766 Aug 03 19:00:30.391471 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 450/884] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:30 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:31.415082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:31.416254 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:31.422751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:31.423197 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:31.423951 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:31.424415 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:31.577505 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:31.585751 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:31.587960 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:31.589151 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3c4d61d5-d8ff-4e13-af62-98a61bff55c8 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.178479 Aug 03 19:00:31.589709 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 435/885] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:31 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:32.613728 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:32.614483 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:32.623074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:32.623606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:32.624580 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:32.625149 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:32.766408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:32.775507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:32.777183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:32.778431 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b59a7095-a473-4d82-bf3e-9768f302954b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.169397 Aug 03 19:00:32.779006 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 451/886] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:32 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:33.945349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:33.946097 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:33.952595 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:33.953042 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:33.953792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:33.954256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:34.088111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:34.096393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:34.098034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:34.099193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9110330c-b42d-49a9-bbee-40c82fd8b901 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.301246 Aug 03 19:00:34.099766 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 436/887] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:33 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:35.123888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:35.124588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:35.131509 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:35.131966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:35.132762 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:35.133207 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:35.271868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:35.280235 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:35.281753 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:35.282909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-37dd03b0-d704-48bb-b4e6-5f8eab8d3c0f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.163002 Aug 03 19:00:35.283469 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 452/888] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:35 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:36.306698 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:36.307523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:36.314598 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:36.315057 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:36.315831 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:36.316271 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:36.448591 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:36.450755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:36.457741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:36.459253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:36.460431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d79a56df-ef77-471e-a922-97f9cd9227f6 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.158270 Aug 03 19:00:36.460991 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 437/889] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:36 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:37.483471 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:37.484228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:37.491227 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:37.491685 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:37.492518 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:37.493018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:37.635842 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:37.644603 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:37.646101 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:37.647326 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b5bc402e-cfa4-4018-9884-985b3d848a24 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.167951 Aug 03 19:00:37.647898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 453/890] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:37 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:38.673671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:38.675280 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:38.686562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:38.687353 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:38.688474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:38.688911 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:38.834001 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:38.842154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:38.843668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:38.844909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f3243249-0d0c-4a29-a561-66da440e62ea tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.177963 Aug 03 19:00:38.845478 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 438/891] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:38 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:39.869045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:39.869660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:39.872986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=28 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:39.877194 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:39.877641 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:39.878406 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:39.878840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:39.883499 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:40.098801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:40.110087 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:40.111713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:40.113110 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1143ceed-b21a-4915-857f-da660a55c445 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.248855 Aug 03 19:00:40.113801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 454/892] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:39 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:40.181336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-f4d5e4bb-54d5-4893-bb1f-14c4be31bec8 req-3a095c93-f427-48ff-9dfd-820ffc5c7278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b197c2f4-4c3c-44a2-a777-6ac04cddbb4d", "name": "network-vif-plugged", "status": "completed", "tag": "3c6f8293-ee04-4b19-94b1-87cab0643fb5"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:00:40.193703 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f4d5e4bb-54d5-4893-bb1f-14c4be31bec8 req-3a095c93-f427-48ff-9dfd-820ffc5c7278 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:40.194667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f4d5e4bb-54d5-4893-bb1f-14c4be31bec8 req-3a095c93-f427-48ff-9dfd-820ffc5c7278 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:40.208163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-f4d5e4bb-54d5-4893-bb1f-14c4be31bec8 req-3a095c93-f427-48ff-9dfd-820ffc5c7278 service nova] Creating event network-vif-plugged:3c6f8293-ee04-4b19-94b1-87cab0643fb5 for instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d on hv-cinder-85164 Aug 03 19:00:40.215594 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-f4d5e4bb-54d5-4893-bb1f-14c4be31bec8 req-3a095c93-f427-48ff-9dfd-820ffc5c7278 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040350 Aug 03 19:00:40.216816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 439/893] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:00:41.137834 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:41.138542 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:41.149153 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:41.150910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:41.151967 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:41.152601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:41.307231 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:41.316806 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:41.318336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:41.319531 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-027b508c-a2d0-4bbd-9e15-28b38e4c26bb tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.186733 Aug 03 19:00:41.320176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 455/894] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:41 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:42.343714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:42.344465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:42.347037 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:42.361918 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:42.362362 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:42.363523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:42.365748 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:42.644829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:42.653833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:42.655362 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:42.662031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a809df9c-5491-43ba-a840-c01a56cce98f tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1730 microversion: 2.20 time: 0.322891 Aug 03 19:00:42.676623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 440/895] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:42 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1730 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:43.688866 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:43.690642 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:43.701090 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:43.701829 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:43.702952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:43.704216 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:43.864300 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:43.873581 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:43.875137 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:00:43.876706 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3a3c76ff-54cb-41c2-b73b-ff105358e91c tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1717 microversion: 2.20 time: 0.193430 Aug 03 19:00:43.877690 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 456/896] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:00:43 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:00:49.346551 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8dcc5067-218a-424d-96b4-c53e282a0b02 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Action: 'create', calling method: .version_select at 0x7fdac9de9550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1199495827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj7BCPUIH+TGn14rtwgdtDqgvHycvnZJIgU77gzI6X26xu1jJm9G19Q7+0AAsNRS6maiY8wR603zB8wg/IvWmxys2yjVj6MgtRSP78OmqkHDQuDZlM6fGrCI0kFwdPD7A=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:00:49.362953 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-8dcc5067-218a-424d-96b4-c53e282a0b02 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Getting quotas for project c00e10f7a413422dba1ab74ef86e0946. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:00:49.367170 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-8dcc5067-218a-424d-96b4-c53e282a0b02 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Getting quotas for user f84fe9ee2c5d48868d73ae651e253f9e and project c00e10f7a413422dba1ab74ef86e0946. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:00:49.391301 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8dcc5067-218a-424d-96b4-c53e282a0b02 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308034 Aug 03 19:00:49.391832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 441/897] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 19:00:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:00:51.471375 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a9dd4b57-c13b-44b6-83e7-9ab47621e694 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:00:51.471879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a9dd4b57-c13b-44b6-83e7-9ab47621e694 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:51.478777 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9dd4b57-c13b-44b6-83e7-9ab47621e694 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:51.479228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9dd4b57-c13b-44b6-83e7-9ab47621e694 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:51.480033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9dd4b57-c13b-44b6-83e7-9ab47621e694 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:51.480514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a9dd4b57-c13b-44b6-83e7-9ab47621e694 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:51.504095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a9dd4b57-c13b-44b6-83e7-9ab47621e694 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/ips" status: 200 len: 144 microversion: 2.1 time: 0.198096 Aug 03 19:00:51.504733 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 457/898] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 19:00:51 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/ips => generated 144 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:00:52.867655 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=15 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:00:52.872916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-789b5a64-cc68-46db-bb29-e2fe16d87dbc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd76b929-3fe8-4d89-990c-04d365507ed6"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:00:52.875205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-789b5a64-cc68-46db-bb29-e2fe16d87dbc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:00:52.883148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-789b5a64-cc68-46db-bb29-e2fe16d87dbc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:52.884497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-789b5a64-cc68-46db-bb29-e2fe16d87dbc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:52.885671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-789b5a64-cc68-46db-bb29-e2fe16d87dbc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:00:52.886292 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-789b5a64-cc68-46db-bb29-e2fe16d87dbc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:00:53.211460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-789b5a64-cc68-46db-bb29-e2fe16d87dbc tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344808 Aug 03 19:00:53.212693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 442/899] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 19:00:52 2022] POST /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:00.763543 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d3f1af3c-7ea3-4521-921d-9f3723539c54 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:00.765849 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d3f1af3c-7ea3-4521-921d-9f3723539c54 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:00.774318 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d3f1af3c-7ea3-4521-921d-9f3723539c54 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:00.775004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d3f1af3c-7ea3-4521-921d-9f3723539c54 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:00.776217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d3f1af3c-7ea3-4521-921d-9f3723539c54 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:00.776934 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d3f1af3c-7ea3-4521-921d-9f3723539c54 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:00.811890 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d3f1af3c-7ea3-4521-921d-9f3723539c54 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052241 Aug 03 19:01:00.812372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 458/900] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:01:00 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:00.820819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=4 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:00.825581 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-89f2c6b0-28b7-4896-9fe3-b177854969b4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:00.826102 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-89f2c6b0-28b7-4896-9fe3-b177854969b4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:00.832540 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-89f2c6b0-28b7-4896-9fe3-b177854969b4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:00.832984 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-89f2c6b0-28b7-4896-9fe3-b177854969b4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:00.833738 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-89f2c6b0-28b7-4896-9fe3-b177854969b4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:00.834173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-89f2c6b0-28b7-4896-9fe3-b177854969b4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:00.865336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-89f2c6b0-28b7-4896-9fe3-b177854969b4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/cd76b929-3fe8-4d89-990c-04d365507ed6" status: 200 len: 194 microversion: 2.1 time: 0.045694 Aug 03 19:01:00.865942 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 443/901] 10.222.0.69 () {58 vars in 1413 bytes} [Wed Aug 3 19:01:00 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/cd76b929-3fe8-4d89-990c-04d365507ed6 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:03.256808 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e57389ea-6861-497d-a48c-7e38ae0ffbb9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b4ab810-e9c9-4ae1-b8fd-6bee56b43133"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:03.259225 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e57389ea-6861-497d-a48c-7e38ae0ffbb9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:03.265848 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57389ea-6861-497d-a48c-7e38ae0ffbb9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:03.266302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57389ea-6861-497d-a48c-7e38ae0ffbb9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:03.267069 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57389ea-6861-497d-a48c-7e38ae0ffbb9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:03.267510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e57389ea-6861-497d-a48c-7e38ae0ffbb9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:03.534356 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e57389ea-6861-497d-a48c-7e38ae0ffbb9 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "POST /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281272 Aug 03 19:01:03.534976 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 459/902] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 19:01:03 2022] POST /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:13.191651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-409a31a7-177b-4127-b877-56048f32a367 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:13.193824 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-409a31a7-177b-4127-b877-56048f32a367 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:13.196179 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:13.197496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:13.204351 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409a31a7-177b-4127-b877-56048f32a367 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:13.204796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409a31a7-177b-4127-b877-56048f32a367 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:13.205558 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409a31a7-177b-4127-b877-56048f32a367 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:13.205993 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-409a31a7-177b-4127-b877-56048f32a367 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:13.237536 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-409a31a7-177b-4127-b877-56048f32a367 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049833 Aug 03 19:01:13.238081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 444/903] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:01:13 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:13.376365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=11 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:13.380856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3ba50e72-79b2-4407-9925-52991afb110b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:13.381447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3ba50e72-79b2-4407-9925-52991afb110b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:13.388888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ba50e72-79b2-4407-9925-52991afb110b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:13.389345 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ba50e72-79b2-4407-9925-52991afb110b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:13.390119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ba50e72-79b2-4407-9925-52991afb110b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:13.390561 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3ba50e72-79b2-4407-9925-52991afb110b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:13.392990 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:13.422337 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3ba50e72-79b2-4407-9925-52991afb110b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/cd76b929-3fe8-4d89-990c-04d365507ed6" status: 200 len: 194 microversion: 2.1 time: 0.047562 Aug 03 19:01:13.422928 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 460/904] 10.222.0.69 () {58 vars in 1413 bytes} [Wed Aug 3 19:01:13 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/cd76b929-3fe8-4d89-990c-04d365507ed6 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:13.433552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:13.434048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:13.439983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:13.440476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:13.441239 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:13.441673 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:13.522134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lazy-loading 'services' on Instance uuid c0364838-7777-408c-be7a-8b9de8091665 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:01:13.595548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-41b408f6-a89a-4fb7-9307-87002da3d15c tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/cd76b929-3fe8-4d89-990c-04d365507ed6" status: 202 len: 0 microversion: 2.1 time: 0.165981 Aug 03 19:01:13.596139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 445/905] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 19:01:13 2022] DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/cd76b929-3fe8-4d89-990c-04d365507ed6 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:01:15.783238 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a3a7af4c-7bb0-455e-a595-688d531ccf7f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:15.783785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a3a7af4c-7bb0-455e-a595-688d531ccf7f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:15.790238 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3a7af4c-7bb0-455e-a595-688d531ccf7f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:15.791264 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3a7af4c-7bb0-455e-a595-688d531ccf7f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:15.792052 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3a7af4c-7bb0-455e-a595-688d531ccf7f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:15.792737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a3a7af4c-7bb0-455e-a595-688d531ccf7f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:15.821924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a3a7af4c-7bb0-455e-a595-688d531ccf7f tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/9b4ab810-e9c9-4ae1-b8fd-6bee56b43133" status: 200 len: 194 microversion: 2.1 time: 0.042582 Aug 03 19:01:15.822662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 461/906] 10.222.0.69 () {58 vars in 1413 bytes} [Wed Aug 3 19:01:15 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/9b4ab810-e9c9-4ae1-b8fd-6bee56b43133 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:15.834106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:15.834684 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:15.841864 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:15.842310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:15.843086 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:15.843510 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:15.923936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lazy-loading 'services' on Instance uuid c0364838-7777-408c-be7a-8b9de8091665 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:01:15.997040 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d6e1630b-ac16-4938-97fa-5d8477703ced tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/9b4ab810-e9c9-4ae1-b8fd-6bee56b43133" status: 202 len: 0 microversion: 2.1 time: 0.167369 Aug 03 19:01:15.997748 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 446/907] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 19:01:15 2022] DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments/9b4ab810-e9c9-4ae1-b8fd-6bee56b43133 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:01:16.292590 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-13017270", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1199495827", "security_groups": [{"name": "tempest-secgroup-smoke-789219203"}], "networks": [{"uuid": "4db470a8-a9bf-434a-85d8-55da95b9dfa8"}], "block_device_mapping_v2": [{"uuid": "d54f9341-2757-4b06-8549-5ce2dda500e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:16.428740 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] validate_networks() for [('4db470a8-a9bf-434a-85d8-55da95b9dfa8', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:01:16.847283 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:01:16.847876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:01:16.848158 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:01:16.848608 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:01:16.849015 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:01:16.858705 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:16.859210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:16.859930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:16.860388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:16.878710 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Getting quotas for project c00e10f7a413422dba1ab74ef86e0946. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:01:16.882636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Getting quotas for user f84fe9ee2c5d48868d73ae651e253f9e and project c00e10f7a413422dba1ab74ef86e0946. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:01:16.942120 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:01:16.944173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d54f9341-2757-4b06-8549-5ce2dda500e2',volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:01:17.073980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e10eba05-7f16-4a74-b34e-7cc6518e1a97 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785468 Aug 03 19:01:17.080703 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 462/908] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:01:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:01:17.086723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-82f16b13-98d7-4065-bdb6-c3f364a3ed2b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:17.087421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-82f16b13-98d7-4065-bdb6-c3f364a3ed2b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:17.169019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-82f16b13-98d7-4065-bdb6-c3f364a3ed2b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:17.175871 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-82f16b13-98d7-4065-bdb6-c3f364a3ed2b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1087 microversion: 2.1 time: 0.093586 Aug 03 19:01:17.176602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 447/909] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:17 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1087 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:17.181799 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b76d6cc1-fe08-435f-ad93-e71c286da998 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:17.184218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b76d6cc1-fe08-435f-ad93-e71c286da998 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:17.191269 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b76d6cc1-fe08-435f-ad93-e71c286da998 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.191724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b76d6cc1-fe08-435f-ad93-e71c286da998 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.192521 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b76d6cc1-fe08-435f-ad93-e71c286da998 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.192969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b76d6cc1-fe08-435f-ad93-e71c286da998 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.222226 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b76d6cc1-fe08-435f-ad93-e71c286da998 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044454 Aug 03 19:01:17.222793 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 463/910] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:01:17 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 03 19:01:17.342070 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b8032961-2417-41d7-96e3-e1bf8ef6fe0a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:17.344391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b8032961-2417-41d7-96e3-e1bf8ef6fe0a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:17.351485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b8032961-2417-41d7-96e3-e1bf8ef6fe0a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.351936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b8032961-2417-41d7-96e3-e1bf8ef6fe0a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.352794 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b8032961-2417-41d7-96e3-e1bf8ef6fe0a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.353363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b8032961-2417-41d7-96e3-e1bf8ef6fe0a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.386877 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b8032961-2417-41d7-96e3-e1bf8ef6fe0a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049779 Aug 03 19:01:17.387642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 448/911] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:01:17 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:01:17.450748 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:17.451255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:17.462142 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.462822 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.463684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.464205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.491161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:01:17.574470 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cb589143-e04a-4673-94d1-9cea2453adf4 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 204 len: 0 microversion: 2.1 time: 0.128062 Aug 03 19:01:17.575124 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 464/912] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:01:17 2022] DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:01:17.583473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:17.584153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:17.590653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.591106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.592162 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:17.592634 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:17.725761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:17.733896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d05e4dee-5cbe-4905-8d4f-7645b9c1c0fa tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1672 microversion: 2.1 time: 0.154392 Aug 03 19:01:17.734468 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 449/913] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:17 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:18.198104 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:18.198718 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:18.205267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:18.205721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:18.206486 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:18.206924 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:18.268157 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:18.276566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0740cf85-df06-4435-9e1c-cd9d1d60d2d2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1137 microversion: 2.1 time: 0.082507 Aug 03 19:01:18.277144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 465/914] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:18 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:18.755775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:18.756452 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:18.763686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:18.764142 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:18.764949 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:18.765391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:18.898359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:18.906924 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-42e9fde8-b4fc-4593-9f32-fc68fb8a296b tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1672 microversion: 2.1 time: 0.155284 Aug 03 19:01:18.907490 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 450/915] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:18 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:19.297767 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:19.298388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:19.305309 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:19.305770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:19.306680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:19.307320 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:19.381788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:19.389715 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cde38b58-5ee2-4e39-b8cf-9f220e3a6b0e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1185 microversion: 2.1 time: 0.096043 Aug 03 19:01:19.390294 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 466/916] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:19 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:19.937070 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:19.938089 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:19.945148 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:19.945610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:19.946394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:19.947328 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:20.166464 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:20.174911 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0e5e7ee1-6857-4742-b095-9c2b9963077a tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1672 microversion: 2.1 time: 0.249159 Aug 03 19:01:20.175570 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 451/917] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:19 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1672 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:20.411869 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:20.412739 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:20.421364 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:20.422301 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:20.423330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:20.423769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:20.499189 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:20.511343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1a61f654-103b-4a66-bcba-88468c308de4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1203 microversion: 2.1 time: 0.104081 Aug 03 19:01:20.512339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 467/918] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:20 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1203 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:20.923111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-bac435ff-02fd-45d3-a5f1-058fc0f11321 req-ef498644-7c78-4b33-8f1b-e52a3e9badfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0364838-7777-408c-be7a-8b9de8091665", "name": "network-vif-deleted", "tag": "e409a276-c19a-4d7d-949e-4938908a8eba"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:20.938259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-bac435ff-02fd-45d3-a5f1-058fc0f11321 req-ef498644-7c78-4b33-8f1b-e52a3e9badfa service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:20.941813 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-bac435ff-02fd-45d3-a5f1-058fc0f11321 req-ef498644-7c78-4b33-8f1b-e52a3e9badfa service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:20.963677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-bac435ff-02fd-45d3-a5f1-058fc0f11321 req-ef498644-7c78-4b33-8f1b-e52a3e9badfa service nova] Creating event network-vif-deleted:e409a276-c19a-4d7d-949e-4938908a8eba for instance c0364838-7777-408c-be7a-8b9de8091665 on hv-cinder-85164 Aug 03 19:01:20.973648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-bac435ff-02fd-45d3-a5f1-058fc0f11321 req-ef498644-7c78-4b33-8f1b-e52a3e9badfa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055028 Aug 03 19:01:20.974517 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 452/919] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:21.198474 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:21.199200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:21.207292 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:21.208180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:21.209916 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:21.211271 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:21.248748 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:21.249436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:21.250080 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lazy-loading 'fault' on Instance uuid c0364838-7777-408c-be7a-8b9de8091665 {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:01:21.315025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13ab977f852a41e898af1ddfb67bad69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d5ff41add94950b7422c6de3e36257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:21.323096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-79b8130b-2a53-47a0-961d-427a1d85b2b7 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 200 len: 1327 microversion: 2.1 time: 0.129282 Aug 03 19:01:21.338101 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 468/920] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:21 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:21.535225 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:21.535968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:21.543632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:21.544304 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:21.546015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:21.546752 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:21.786827 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:21.798326 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c5fdf15d-9118-4e3e-bcef-e65c18a813de tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.268233 Aug 03 19:01:21.813196 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 453/921] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:21 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:21.865560 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-a3c34c89-f38b-4f27-9f9e-eb9c02839f16 req-d73c7e9a-4fe6-4ac6-ad94-74f99cdc5150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e484cc-859c-4404-b392-b50dcc4cfc66", "tag": "ee6ca9cd-b14a-4853-9072-8075423e62ae"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:21.876463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-a3c34c89-f38b-4f27-9f9e-eb9c02839f16 req-d73c7e9a-4fe6-4ac6-ad94-74f99cdc5150 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:21.876937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-a3c34c89-f38b-4f27-9f9e-eb9c02839f16 req-d73c7e9a-4fe6-4ac6-ad94-74f99cdc5150 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:21.889151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-a3c34c89-f38b-4f27-9f9e-eb9c02839f16 req-d73c7e9a-4fe6-4ac6-ad94-74f99cdc5150 service nova] Creating event network-changed:ee6ca9cd-b14a-4853-9072-8075423e62ae for instance f7e484cc-859c-4404-b392-b50dcc4cfc66 on hv-cinder-85164 Aug 03 19:01:21.893913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-a3c34c89-f38b-4f27-9f9e-eb9c02839f16 req-d73c7e9a-4fe6-4ac6-ad94-74f99cdc5150 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125504 Aug 03 19:01:21.894798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 469/922] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:22.344319 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:22.344964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:22.351675 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:22.352310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:22.354334 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:22.354866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:22.368151 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] HTTP exception thrown: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Request method failure captured: Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 HTTP/1.1 Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN0u66y5EekGZG_aXZFopuwyL4-ZQejKMQlHFyhR5WHjRZ42hgNmCfwqWAXWYgu-FFtFKFUU1e1MlCRVw7u5_G7NwTHXxbcH3l62y6kWxR_y1d-eFYU0ISTAbN7fk98t7lNzAcF7Jc02xD2euwGkHXTq-xkJSk5DLQFx2OQ42Jf794 Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:22.370761 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77d5ff41add94950b7422c6de3e36257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 13ab977f852a41e898af1ddfb67bad69 Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:22.372697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'c0364838-7777-408c-be7a-8b9de8091665'} Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:22.373849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:22.375479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:22.377336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Returning 404 to user: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:22.377336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a0e286ac-c4c1-4d58-8dad-289b9a9e0246 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 404 len: 111 microversion: 2.1 time: 0.031897 Aug 03 19:01:22.377336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 454/923] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:22 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:01:22.384011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-51c4faa3-8582-4ab2-bf0f-80b9171c5e5e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '.version_select at 0x7fdaca0fa160>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:22.388977 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR oslo.messaging._drivers.impl_rabbit [None req-51c4faa3-8582-4ab2-bf0f-80b9171c5e5e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [661469dc-dc08-42c8-b8c0-25c0c9aea8f8] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 19:01:22.820274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:22.820909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:22.827292 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:22.827744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:22.828535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:22.829002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:22.969274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:22.976775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-dabaf237-bd97-4570-a130-8ecfb277a828 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.160377 Aug 03 19:01:22.977332 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 455/924] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:22 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:01:23.396131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [None req-51c4faa3-8582-4ab2-bf0f-80b9171c5e5e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [661469dc-dc08-42c8-b8c0-25c0c9aea8f8] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 40378. Aug 03 19:01:23.413928 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-51c4faa3-8582-4ab2-bf0f-80b9171c5e5e tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200459066" status: 202 len: 0 microversion: 2.1 time: 1.034678 Aug 03 19:01:23.414526 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 470/925] 10.222.0.69 () {58 vars in 1221 bytes} [Wed Aug 3 19:01:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200459066 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:01:23.998355 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:23.999384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:24.007024 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:24.007548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:24.008412 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:24.008863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:24.158448 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:24.165826 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-37fbf87a-e4ba-41ff-bd99-3da5a9644b32 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.172194 Aug 03 19:01:24.166381 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 456/926] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:23 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:25.189130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:25.190004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:25.197039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:25.197518 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:25.198698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:25.199569 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:25.349858 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:25.358157 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3b43e2f7-c63c-4d33-82d5-332c693f60c7 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.173309 Aug 03 19:01:25.358747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 471/927] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:25 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:26.344235 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:26.345165 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:26.351623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:26.352074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:26.352882 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:26.353328 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:26.367805 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] HTTP exception thrown: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Request method failure captured: Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 HTTP/1.1 Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN0u66y5EekGZG_aXZFopuwyL4-ZQejKMQlHFyhR5WHjRZ42hgNmCfwqWAXWYgu-FFtFKFUU1e1MlCRVw7u5_G7NwTHXxbcH3l62y6kWxR_y1d-eFYU0ISTAbN7fk98t7lNzAcF7Jc02xD2euwGkHXTq-xkJSk5DLQFx2OQ42Jf794 Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:26.369371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77d5ff41add94950b7422c6de3e36257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 13ab977f852a41e898af1ddfb67bad69 Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.371000 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'c0364838-7777-408c-be7a-8b9de8091665'} Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:26.372224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.373837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.375522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Returning 404 to user: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:26.375522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f808da2f-2f33-44de-858d-ddb879536082 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 404 len: 111 microversion: 2.1 time: 0.031231 Aug 03 19:01:26.375522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 457/928] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:01:26 2022] DELETE /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:01:26.379810 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:26.380459 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: c0364838-7777-408c-be7a-8b9de8091665] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:26.380570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:26.381204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:26.386554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:26.387063 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:26.388021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:26.388144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:26.388567 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:26.388682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:26.389340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:26.389783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:26.402114 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] HTTP exception thrown: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Request method failure captured: Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 HTTP/1.1 Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN0u66y5EekGZG_aXZFopuwyL4-ZQejKMQlHFyhR5WHjRZ42hgNmCfwqWAXWYgu-FFtFKFUU1e1MlCRVw7u5_G7NwTHXxbcH3l62y6kWxR_y1d-eFYU0ISTAbN7fk98t7lNzAcF7Jc02xD2euwGkHXTq-xkJSk5DLQFx2OQ42Jf794 Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:26.404309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77d5ff41add94950b7422c6de3e36257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 13ab977f852a41e898af1ddfb67bad69 Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.405916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'c0364838-7777-408c-be7a-8b9de8091665'} Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:26.406795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. Aug 03 19:01:26.408747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:26.410035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Returning 404 to user: Instance c0364838-7777-408c-be7a-8b9de8091665 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:26.410035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2521329f-15ff-4c44-a6d9-b69e97477940 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665" status: 404 len: 111 microversion: 2.1 time: 0.029882 Aug 03 19:01:26.410035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 458/929] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:26 2022] GET /compute/v2.1/servers/c0364838-7777-408c-be7a-8b9de8091665 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:01:26.533333 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:26.540765 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-357a4bfb-2ce2-4855-8dfb-704fd205f4fb tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.164895 Aug 03 19:01:26.541333 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 472/930] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:26 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:27.551004 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:27.551506 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:27.553485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:27.559593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:27.560046 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:27.560860 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:27.561300 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:27.561962 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:27.562584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:27.564584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:27.565330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:27.571707 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:27.572165 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:27.572970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:27.573414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:27.576998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] HTTP exception thrown: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Request method failure captured: Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 HTTP/1.1 Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN0u66y5EekGZG_aXZFopuwyL4-ZQejKMQlHFyhR5WHjRZ42hgNmCfwqWAXWYgu-FFtFKFUU1e1MlCRVw7u5_G7NwTHXxbcH3l62y6kWxR_y1d-eFYU0ISTAbN7fk98t7lNzAcF7Jc02xD2euwGkHXTq-xkJSk5DLQFx2OQ42Jf794 Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:27.578548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77d5ff41add94950b7422c6de3e36257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 13ab977f852a41e898af1ddfb67bad69 Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.580002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '800ff343-a07b-438f-9353-240b8ce592a9'} Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:27.580840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.582071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.585149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Returning 404 to user: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:27.585149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-06467efd-ec31-4503-b0f3-ed8fed28dce2 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "DELETE /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 404 len: 111 microversion: 2.1 time: 0.032790 Aug 03 19:01:27.585149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 459/931] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:01:27 2022] DELETE /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:01:27.591639 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:27.592263 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] [instance: 800ff343-a07b-438f-9353-240b8ce592a9] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:27.598279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:27.598730 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:27.599503 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:27.599939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:27.615101 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] HTTP exception thrown: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Request method failure captured: Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 HTTP/1.1 Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN0u66y5EekGZG_aXZFopuwyL4-ZQejKMQlHFyhR5WHjRZ42hgNmCfwqWAXWYgu-FFtFKFUU1e1MlCRVw7u5_G7NwTHXxbcH3l62y6kWxR_y1d-eFYU0ISTAbN7fk98t7lNzAcF7Jc02xD2euwGkHXTq-xkJSk5DLQFx2OQ42Jf794 Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:27.616693 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_77d5ff41add94950b7422c6de3e36257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/77d5ff41add94950b7422c6de3e36257"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 77d5ff41add94950b7422c6de3e36257 Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeTestJSON-517153364 Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 13ab977f852a41e898af1ddfb67bad69 Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeTestJSON-517153364-project Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.618322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '800ff343-a07b-438f-9353-240b8ce592a9'} Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:27.620320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. Aug 03 19:01:27.621956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:27.623065 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] Returning 404 to user: Instance 800ff343-a07b-438f-9353-240b8ce592a9 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:27.623065 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d8dfa6fe-aac7-43c3-8182-fe22557670b8 tempest-AttachVolumeTestJSON-517153364 tempest-AttachVolumeTestJSON-517153364-project] 10.222.0.69 "GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9" status: 404 len: 111 microversion: 2.1 time: 0.031220 Aug 03 19:01:27.623065 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 460/932] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:27 2022] GET /compute/v2.1/servers/800ff343-a07b-438f-9353-240b8ce592a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:01:27.719185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:27.727773 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5c30fc91-ac60-4358-b5a3-444be08a77b3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.170143 Aug 03 19:01:27.728624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 473/933] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:27 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:01:28.748897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:28.750164 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:28.757080 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:28.757536 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:28.758311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:28.758753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:28.899781 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:28.908051 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-61476807-c340-4565-aa86-a92e359782d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.163776 Aug 03 19:01:28.908713 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 461/934] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:28 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:29.930068 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:29.930673 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:29.938325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:29.938780 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:29.939591 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:29.940032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:30.085036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:30.093357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a2c1133b-d2d1-4c83-8e57-1b7c217685e0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.167082 Aug 03 19:01:30.093949 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 474/935] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:29 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:31.114285 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:31.114900 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:31.122329 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:31.122850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:31.123616 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:31.124047 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:31.272850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:31.285313 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3458370d-c1d2-4f39-a072-d76e1f967187 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.174695 Aug 03 19:01:31.285901 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 462/936] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:31 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:32.307463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:32.308256 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:32.315796 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:32.316252 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:32.317067 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:32.317505 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:32.550305 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:32.560644 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a95d5455-8621-4513-8ccb-a802d855cccf tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.257244 Aug 03 19:01:32.561620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 475/937] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:32 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:33.582280 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:33.582963 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:33.589518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:33.590652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:33.592130 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:33.593289 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:33.857790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:33.866316 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-81d51ff1-e4d9-48c7-aa29-a7685012f10a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.287869 Aug 03 19:01:33.866885 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 463/938] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:33 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:35.001205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:35.001205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:35.001205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:35.001205 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:35.002636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-8231eec8-fafa-46b1-b697-344b126fb2e4 req-3e59426a-bc05-4110-8b43-9c7e55614bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e484cc-859c-4404-b392-b50dcc4cfc66", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ca9cd-b14a-4853-9072-8075423e62ae"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:35.003392 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:35.003392 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:35.003392 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:35.003699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-8231eec8-fafa-46b1-b697-344b126fb2e4 req-3e59426a-bc05-4110-8b43-9c7e55614bc9 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:35.003699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-8231eec8-fafa-46b1-b697-344b126fb2e4 req-3e59426a-bc05-4110-8b43-9c7e55614bc9 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:35.003699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-8231eec8-fafa-46b1-b697-344b126fb2e4 req-3e59426a-bc05-4110-8b43-9c7e55614bc9 service nova] Creating event network-vif-plugged:ee6ca9cd-b14a-4853-9072-8075423e62ae for instance f7e484cc-859c-4404-b392-b50dcc4cfc66 on hv-cinder-85164 Aug 03 19:01:35.003699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-8231eec8-fafa-46b1-b697-344b126fb2e4 req-3e59426a-bc05-4110-8b43-9c7e55614bc9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267887 Aug 03 19:01:35.003699 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 476/939] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:35.615975 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:35.624735 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-28364c8a-a5d3-4712-967a-78902c5b0e73 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.739659 Aug 03 19:01:35.625423 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 464/940] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:34 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:01:36.648419 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:36.649203 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:36.661930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:36.662418 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:36.663293 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:36.663796 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:36.912723 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:36.917580 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:36.938288 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2da31975-a28d-4017-aa64-6ec88d233dca tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1258 microversion: 2.1 time: 0.295183 Aug 03 19:01:36.960361 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 477/941] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:36 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1258 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:37.071307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9c77027f-19c8-4fab-9bde-c2672236a524 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: .version_select at 0x7fdac9d8c0d0>, body: {"keypair": {"name": "tempest-keypair-1533332650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOm8WR+xeN8EHzBcE3LB1y/oanjL3iOnXbzCzDT9MMyeMWOcxK6oDg7nphFM7MDCXhQaQcosBhB8eTuk/pWHlEb6YX56OQLvSGtg6j4z+zE3l1mEIdBSFjUkkw+5uDeezQ=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:37.087682 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-9c77027f-19c8-4fab-9bde-c2672236a524 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:01:37.092961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-9c77027f-19c8-4fab-9bde-c2672236a524 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:01:37.117139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9c77027f-19c8-4fab-9bde-c2672236a524 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107501 Aug 03 19:01:37.117737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 465/942] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 19:01:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:37.963303 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:37.964257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:37.974042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:37.974490 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:37.975573 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:37.976009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:38.192268 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:38.201368 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9caf6052-9e13-4129-bebd-87f34ab598e2 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1442 microversion: 2.1 time: 0.242156 Aug 03 19:01:38.202251 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 478/943] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:37 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1442 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:38.223347 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:38.224478 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:38.232860 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:38.233306 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:38.234601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:38.235215 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:38.458874 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:38.470011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fc9d47ab-5a9a-40bd-9113-578a5b5858da tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1442 microversion: 2.1 time: 0.251126 Aug 03 19:01:38.470854 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 466/944] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:38 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1442 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:38.616023 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1172604300", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7445c4-4df7-4e9a-ab26-f2a5eef98b34"}], "security_groups": [{"name": "tempest-securitygroup--1741831902"}], "key_name": "tempest-keypair-1533332650", "user_data": "}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:38.744469 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] validate_networks() for [('9b7445c4-4df7-4e9a-ab26-f2a5eef98b34', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:01:39.210646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:01:39.211242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:01:39.211835 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:01:39.213018 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:01:39.213867 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:01:39.225537 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:39.226132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:39.227753 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:39.228464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:39.260708 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:01:39.266197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:01:39.279463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:01:39.281874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:01:39.337591 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-297c734a-dbfa-4e17-8259-ae5bc3713fb2 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725759 Aug 03 19:01:39.338814 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 479/945] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:01:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:01:39.353435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0af7143a-f864-42ca-8da8-4b760044e7d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:39.355253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0af7143a-f864-42ca-8da8-4b760044e7d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:39.414849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0af7143a-f864-42ca-8da8-4b760044e7d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:39.423128 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0af7143a-f864-42ca-8da8-4b760044e7d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1242 microversion: 2.1 time: 0.076138 Aug 03 19:01:39.436466 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 467/946] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:39 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:40.443217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:40.443917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:40.452491 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:40.453121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:40.453913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:40.454383 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:40.525743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:40.535414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-71d68e1f-a898-4e97-96c9-5128237023aa tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1294 microversion: 2.1 time: 0.096210 Aug 03 19:01:40.535998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 480/947] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:40 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:40.789785 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-f66a489a-837c-48a9-9f72-73273f2cc4c4 req-e2afe71b-4a77-4ad6-ad00-fd32210f8f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e484cc-859c-4404-b392-b50dcc4cfc66", "tag": "ee6ca9cd-b14a-4853-9072-8075423e62ae"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:40.803465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f66a489a-837c-48a9-9f72-73273f2cc4c4 req-e2afe71b-4a77-4ad6-ad00-fd32210f8f0b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:40.803915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f66a489a-837c-48a9-9f72-73273f2cc4c4 req-e2afe71b-4a77-4ad6-ad00-fd32210f8f0b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:40.817866 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-f66a489a-837c-48a9-9f72-73273f2cc4c4 req-e2afe71b-4a77-4ad6-ad00-fd32210f8f0b service nova] Creating event network-changed:ee6ca9cd-b14a-4853-9072-8075423e62ae for instance f7e484cc-859c-4404-b392-b50dcc4cfc66 on hv-cinder-85164 Aug 03 19:01:40.824047 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-f66a489a-837c-48a9-9f72-73273f2cc4c4 req-e2afe71b-4a77-4ad6-ad00-fd32210f8f0b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038691 Aug 03 19:01:40.826531 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 468/948] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:41.556563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:41.562028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:41.570903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:41.571421 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:41.572276 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:41.572948 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:41.819227 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:41.829175 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ef548cfe-d18b-4b86-9640-bf148b94466d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.276474 Aug 03 19:01:41.830150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 481/949] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:41 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:42.234686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-8e4cb67c-d255-47b2-96ff-af8ac9d0b282 req-a153ba7d-1102-4bae-82f6-6db3d6b99089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1630d33-81ce-4d63-ad4e-bd5d1eb5359d", "tag": "57ecbc9b-315d-4270-9735-de2f9f63e6b1"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:42.244327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8e4cb67c-d255-47b2-96ff-af8ac9d0b282 req-a153ba7d-1102-4bae-82f6-6db3d6b99089 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:42.244780 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8e4cb67c-d255-47b2-96ff-af8ac9d0b282 req-a153ba7d-1102-4bae-82f6-6db3d6b99089 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:42.258632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-8e4cb67c-d255-47b2-96ff-af8ac9d0b282 req-a153ba7d-1102-4bae-82f6-6db3d6b99089 service nova] Creating event network-changed:57ecbc9b-315d-4270-9735-de2f9f63e6b1 for instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d on hv-cinder-85164 Aug 03 19:01:42.265583 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-8e4cb67c-d255-47b2-96ff-af8ac9d0b282 req-a153ba7d-1102-4bae-82f6-6db3d6b99089 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035328 Aug 03 19:01:42.266769 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 469/950] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:42.850590 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:42.851198 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:42.858554 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:42.859003 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:42.859765 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:42.860200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:42.996978 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:43.004507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3c1696aa-e986-40dd-976b-d0a980d002d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.157756 Aug 03 19:01:43.005078 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 482/951] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:42 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:44.026011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:44.026712 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:44.029475 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:44.035830 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:44.036282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:44.037074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:44.037514 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:44.170204 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:44.177571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-11d203f2-d2e0-4ba7-afb7-631d9790bcba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.156265 Aug 03 19:01:44.178135 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 470/952] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:44 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:45.198079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:45.198625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:45.201826 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:45.206982 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:45.207432 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:45.208192 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:45.208647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:45.363546 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:45.371590 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e73fba20-7807-488b-9c71-760600340793 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.176885 Aug 03 19:01:45.372523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 483/953] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:45 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:01:46.393029 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:46.393639 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:46.399593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:46.400035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:46.400830 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:46.401269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:46.535214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:46.542560 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d9d370d7-15b4-4288-9421-1295f2d3db8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.153604 Aug 03 19:01:46.544194 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 471/954] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:46 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:47.563797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:47.564559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:47.571330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:47.571788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:47.572628 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:47.573073 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:47.709631 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:47.717377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-48e9e849-6d0e-41de-bc91-fcfcf28ed607 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.157580 Aug 03 19:01:47.717939 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 484/955] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:47 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:48.663589 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-592faeeb-3f21-405b-abfe-cc8aaa30e5b5 req-18a58ba5-84b9-401c-80bb-350743c2388c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1630d33-81ce-4d63-ad4e-bd5d1eb5359d", "name": "network-vif-plugged", "status": "completed", "tag": "57ecbc9b-315d-4270-9735-de2f9f63e6b1"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:48.675574 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-592faeeb-3f21-405b-abfe-cc8aaa30e5b5 req-18a58ba5-84b9-401c-80bb-350743c2388c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:48.676025 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-592faeeb-3f21-405b-abfe-cc8aaa30e5b5 req-18a58ba5-84b9-401c-80bb-350743c2388c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:48.688212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-592faeeb-3f21-405b-abfe-cc8aaa30e5b5 req-18a58ba5-84b9-401c-80bb-350743c2388c service nova] Creating event network-vif-plugged:57ecbc9b-315d-4270-9735-de2f9f63e6b1 for instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d on hv-cinder-85164 Aug 03 19:01:48.693405 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-592faeeb-3f21-405b-abfe-cc8aaa30e5b5 req-18a58ba5-84b9-401c-80bb-350743c2388c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033501 Aug 03 19:01:48.694101 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 472/956] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:48.738401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:48.739022 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:48.747984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:48.748476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:48.749263 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:48.749708 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:48.896667 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:48.905222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d4a2bea3-b6c5-438d-82f4-c88ef2cb4f8f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.170897 Aug 03 19:01:48.905803 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 485/957] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:48 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:49.923038 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:49.927718 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:49.928475 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:49.936393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:49.936393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:49.937170 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:49.937653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:50.069851 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:50.078251 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6a97633d-cba0-440d-a6fb-c3a10e5d60c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1368 microversion: 2.1 time: 0.156262 Aug 03 19:01:50.078821 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 473/958] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:49 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:51.098992 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:51.099589 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:51.101564 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:51.102360 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:01:51.108959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.109407 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.110184 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.110620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.235964 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-421681e2-6ef0-4c0c-a4aa-f655ac5db11b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:51.238160 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-421681e2-6ef0-4c0c-a4aa-f655ac5db11b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:51.244597 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-421681e2-6ef0-4c0c-a4aa-f655ac5db11b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.245052 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-421681e2-6ef0-4c0c-a4aa-f655ac5db11b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.245823 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-421681e2-6ef0-4c0c-a4aa-f655ac5db11b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.246755 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-421681e2-6ef0-4c0c-a4aa-f655ac5db11b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.247901 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:51.255797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0e49249b-8f8d-460e-9091-873006dc619e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1558 microversion: 2.1 time: 0.160631 Aug 03 19:01:51.256392 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 486/959] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:01:51 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:01:51.277297 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-421681e2-6ef0-4c0c-a4aa-f655ac5db11b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045234 Aug 03 19:01:51.277871 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 474/960] 10.222.0.69 () {60 vars in 1343 bytes} [Wed Aug 3 19:01:51 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:01:51.288181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7602e58c-2a2f-4150-b34d-773e880a9ed1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:51.288739 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7602e58c-2a2f-4150-b34d-773e880a9ed1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:51.296590 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7602e58c-2a2f-4150-b34d-773e880a9ed1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.297079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7602e58c-2a2f-4150-b34d-773e880a9ed1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.297946 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7602e58c-2a2f-4150-b34d-773e880a9ed1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.298461 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7602e58c-2a2f-4150-b34d-773e880a9ed1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.342943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:51.343452 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:51.349460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.349907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.350672 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.351108 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.376658 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:01:51.388460 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7602e58c-2a2f-4150-b34d-773e880a9ed1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104130 Aug 03 19:01:51.389071 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 487/961] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 19:01:51 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:51.457968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-01bbe707-719e-4e89-9a2b-57a7b2d180e4 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 204 len: 0 microversion: 2.20 time: 0.118753 Aug 03 19:01:51.458849 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 475/962] 10.222.0.69 () {60 vars in 1280 bytes} [Wed Aug 3 19:01:51 2022] DELETE /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 03 19:01:51.468650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:51.469658 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:51.476107 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.476602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.477382 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:51.477914 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:51.614063 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:51.623082 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:51.624651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:51.625842 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dff8476c-7ccb-4f63-b012-48fd2183807a tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.162623 Aug 03 19:01:51.626411 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 488/963] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:01:51 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 19:01:52.351975 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-b6cb865b-594c-4ac5-80f7-e4808c41393a req-22d806fb-a81e-4d3b-a7ff-788d9e78e180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1630d33-81ce-4d63-ad4e-bd5d1eb5359d", "tag": "57ecbc9b-315d-4270-9735-de2f9f63e6b1"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:52.361943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-b6cb865b-594c-4ac5-80f7-e4808c41393a req-22d806fb-a81e-4d3b-a7ff-788d9e78e180 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:52.362390 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-b6cb865b-594c-4ac5-80f7-e4808c41393a req-22d806fb-a81e-4d3b-a7ff-788d9e78e180 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:52.375714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-b6cb865b-594c-4ac5-80f7-e4808c41393a req-22d806fb-a81e-4d3b-a7ff-788d9e78e180 service nova] Creating event network-changed:57ecbc9b-315d-4270-9735-de2f9f63e6b1 for instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d on hv-cinder-85164 Aug 03 19:01:52.380783 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-b6cb865b-594c-4ac5-80f7-e4808c41393a req-22d806fb-a81e-4d3b-a7ff-788d9e78e180 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033023 Aug 03 19:01:52.381388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 476/964] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:01:52.649242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:52.649851 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:52.657248 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:52.657698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:52.658464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:52.658895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:53.123451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:53.131943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:53.133499 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:53.134682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9e88d619-d011-4bfb-b98e-4f6556441e52 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1723 microversion: 2.20 time: 0.489349 Aug 03 19:01:53.135260 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 489/965] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:01:52 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1723 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:01:54.159615 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:54.160579 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:54.167329 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:54.167916 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:54.169311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:54.170530 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:54.249882 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:54.285514 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:54.287359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1aa1d56d9b154e32aa1c136b577d49f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e125626c9566484b837b582ba7096598', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:01:54.288767 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4e18986a-f2d1-4e4b-ab78-fe7d39e1005b tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 200 len: 1655 microversion: 2.20 time: 0.134075 Aug 03 19:01:54.289884 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 477/966] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:01:54 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 1655 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 19:01:54.396500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-36f307cf-7721-4656-ac46-44ba1d943c7d req-67ff989b-4a02-4af5-ac9a-336b4c84da4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b197c2f4-4c3c-44a2-a777-6ac04cddbb4d", "name": "network-vif-deleted", "tag": "3c6f8293-ee04-4b19-94b1-87cab0643fb5"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:01:54.409168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-36f307cf-7721-4656-ac46-44ba1d943c7d req-67ff989b-4a02-4af5-ac9a-336b4c84da4b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:54.409697 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-36f307cf-7721-4656-ac46-44ba1d943c7d req-67ff989b-4a02-4af5-ac9a-336b4c84da4b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:54.423250 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-36f307cf-7721-4656-ac46-44ba1d943c7d req-67ff989b-4a02-4af5-ac9a-336b4c84da4b service nova] Creating event network-vif-deleted:3c6f8293-ee04-4b19-94b1-87cab0643fb5 for instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d on hv-cinder-85164 Aug 03 19:01:54.428689 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-36f307cf-7721-4656-ac46-44ba1d943c7d req-67ff989b-4a02-4af5-ac9a-336b4c84da4b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035641 Aug 03 19:01:54.429295 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 490/967] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:01:55.313260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:55.313872 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:55.320470 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:55.320918 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:55.321675 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:55.322111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:55.335568 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] HTTP exception thrown: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Request method failure captured: Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d HTTP/1.1 Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN3rUmVZtIYkiVe309NJBmWr-ptK3htRkqlFPQDvmSRggvaS-GgzKiKUKl8W6hnwUvaZy7ZAeduAIHMRylnP9RNdKV4aHpnOFf5-hrOKkWKKbQCvR07YGAMhxtIi1ivCmI-Y2j6504bp0DQBkp2wgzBBS5_Zsv53uonYs20YJNu6SM Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:55.337262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e125626c9566484b837b582ba7096598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e125626c9566484b837b582ba7096598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1aa1d56d9b154e32aa1c136b577d49f4 Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:55.338998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'b197c2f4-4c3c-44a2-a777-6ac04cddbb4d'} Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:55.340716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:55.342642 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:55.344068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Returning 404 to user: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:55.344068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-14c4920e-3144-40ec-b022-1be99f0cadc9 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 404 len: 111 microversion: 2.20 time: 0.029645 Aug 03 19:01:55.344068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 478/968] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:01:55 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:01:55.349613 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b6d5f42f-61c8-4e45-8d96-ba9278a521b5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '.version_select at 0x7fdaca31be50>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:55.368727 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b6d5f42f-61c8-4e45-8d96-ba9278a521b5 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989757676" status: 204 len: 0 microversion: 2.20 time: 0.023390 Aug 03 19:01:55.369283 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 491/969] 10.222.0.69 () {60 vars in 1259 bytes} [Wed Aug 3 19:01:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989757676 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 19:01:57.133607 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:57.134111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:57.141019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:57.141475 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:57.142275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:57.142715 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:57.156552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] HTTP exception thrown: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Request method failure captured: Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d HTTP/1.1 Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN3rUmVZtIYkiVe309NJBmWr-ptK3htRkqlFPQDvmSRggvaS-GgzKiKUKl8W6hnwUvaZy7ZAeduAIHMRylnP9RNdKV4aHpnOFf5-hrOKkWKKbQCvR07YGAMhxtIi1ivCmI-Y2j6504bp0DQBkp2wgzBBS5_Zsv53uonYs20YJNu6SM Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:57.158103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e125626c9566484b837b582ba7096598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e125626c9566484b837b582ba7096598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1aa1d56d9b154e32aa1c136b577d49f4 Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.159796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'b197c2f4-4c3c-44a2-a777-6ac04cddbb4d'} Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:57.160799 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.162282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.163805 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Returning 404 to user: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:57.163805 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-db96d106-eabb-4d48-9dbe-85cb8aa73155 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 404 len: 111 microversion: 2.20 time: 0.029701 Aug 03 19:01:57.163805 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 479/970] 10.222.0.69 () {60 vars in 1280 bytes} [Wed Aug 3 19:01:57 2022] DELETE /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:01:57.174159 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:57.174885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: b197c2f4-4c3c-44a2-a777-6ac04cddbb4d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:57.181045 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:57.181491 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:57.182246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:57.182679 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:57.196144 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] HTTP exception thrown: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Request method failure captured: Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d HTTP/1.1 Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sN3rUmVZtIYkiVe309NJBmWr-ptK3htRkqlFPQDvmSRggvaS-GgzKiKUKl8W6hnwUvaZy7ZAeduAIHMRylnP9RNdKV4aHpnOFf5-hrOKkWKKbQCvR07YGAMhxtIi1ivCmI-Y2j6504bp0DQBkp2wgzBBS5_Zsv53uonYs20YJNu6SM Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:01:57.197745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e125626c9566484b837b582ba7096598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e125626c9566484b837b582ba7096598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 1aa1d56d9b154e32aa1c136b577d49f4 Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.199487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'b197c2f4-4c3c-44a2-a777-6ac04cddbb4d'} Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:57.200660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. Aug 03 19:01:57.202220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:57.204217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Returning 404 to user: Instance b197c2f4-4c3c-44a2-a777-6ac04cddbb4d could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:57.204217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9d6532b2-46be-406b-bbd1-b3e99c816eb7 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d" status: 404 len: 111 microversion: 2.20 time: 0.030845 Aug 03 19:01:57.204217 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 492/971] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:01:57 2022] GET /compute/v2.1/servers/b197c2f4-4c3c-44a2-a777-6ac04cddbb4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:01:58.341874 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:58.342364 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:58.348868 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:58.349316 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:58.350078 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:58.350516 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:58.364758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] HTTP exception thrown: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Request method failure captured: Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd HTTP/1.1 Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sN3rUmVZtIYkiVe309NJBmWr-ptK3htRkqlFPQDvmSRggvaS-GgzKiKUKl8W6hnwUvaZy7ZAeduAIHMRylnP9RNdKV4aHpnOFf5-hrOKkWKKbQCvR07YGAMhxtIi1ivCmI-Y2j6504bp0DQBkp2wgzBBS5_Zsv53uonYs20YJNu6SM Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:01:58.366337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e125626c9566484b837b582ba7096598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e125626c9566484b837b582ba7096598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 1aa1d56d9b154e32aa1c136b577d49f4 Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.368060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '75afca33-3ec7-4c03-9d25-a247fc1e47bd'} Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:58.369050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.370330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.372703 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Returning 404 to user: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:58.372703 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8eb7f144-6ac4-44bc-97ae-4f46da088565 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "DELETE /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 404 len: 111 microversion: 2.20 time: 0.030467 Aug 03 19:01:58.372703 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 480/972] 10.222.0.69 () {60 vars in 1280 bytes} [Wed Aug 3 19:01:58 2022] DELETE /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:01:58.376744 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:01:58.377355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] [instance: 75afca33-3ec7-4c03-9d25-a247fc1e47bd] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:01:58.384536 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:58.384986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:58.385738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:01:58.386170 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:01:58.399508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] HTTP exception thrown: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Request method failure captured: Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd HTTP/1.1 Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sN3rUmVZtIYkiVe309NJBmWr-ptK3htRkqlFPQDvmSRggvaS-GgzKiKUKl8W6hnwUvaZy7ZAeduAIHMRylnP9RNdKV4aHpnOFf5-hrOKkWKKbQCvR07YGAMhxtIi1ivCmI-Y2j6504bp0DQBkp2wgzBBS5_Zsv53uonYs20YJNu6SM Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:01:58.401058 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e125626c9566484b837b582ba7096598"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e125626c9566484b837b582ba7096598"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e125626c9566484b837b582ba7096598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: e125626c9566484b837b582ba7096598 Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1328735308 Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 1aa1d56d9b154e32aa1c136b577d49f4 Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1328735308-project Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.402998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '75afca33-3ec7-4c03-9d25-a247fc1e47bd'} Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:01:58.404092 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. Aug 03 19:01:58.405683 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:01:58.407331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] Returning 404 to user: Instance 75afca33-3ec7-4c03-9d25-a247fc1e47bd could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:01:58.407331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-3a4c28c7-ae0b-4c86-bcfa-29aae6f00f38 tempest-AttachVolumeShelveTestJSON-1328735308 tempest-AttachVolumeShelveTestJSON-1328735308-project] 10.222.0.69 "GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd" status: 404 len: 111 microversion: 2.20 time: 0.029620 Aug 03 19:01:58.407331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 493/973] 10.222.0.69 () {60 vars in 1277 bytes} [Wed Aug 3 19:01:58 2022] GET /compute/v2.1/servers/75afca33-3ec7-4c03-9d25-a247fc1e47bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 03 19:03:51.126432 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:51.127259 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:51.131106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-32bf0265-5607-48d6-94a2-bfc6d7302d5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:03:51.131853 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-32bf0265-5607-48d6-94a2-bfc6d7302d5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:51.140783 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32bf0265-5607-48d6-94a2-bfc6d7302d5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:51.141230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32bf0265-5607-48d6-94a2-bfc6d7302d5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:51.141992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32bf0265-5607-48d6-94a2-bfc6d7302d5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:51.142495 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-32bf0265-5607-48d6-94a2-bfc6d7302d5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:51.170405 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-32bf0265-5607-48d6-94a2-bfc6d7302d5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/ips" status: 200 len: 150 microversion: 2.1 time: 0.045823 Aug 03 19:03:51.170982 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 481/974] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 19:03:51 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:03:52.546602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a973d65e-9bc3-4bb9-ab7c-0d2c967cb081] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 19:03:52.547190 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:52.547939 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=73 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:03:52.552410 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4be10fce-95f0-40b4-a28f-034a391fafd3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d7be18f-8f43-4635-8ba9-4a88d114db79"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:03:52.554732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4be10fce-95f0-40b4-a28f-034a391fafd3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:03:52.566611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4be10fce-95f0-40b4-a28f-034a391fafd3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:52.567464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4be10fce-95f0-40b4-a28f-034a391fafd3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:52.568966 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4be10fce-95f0-40b4-a28f-034a391fafd3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:03:52.569852 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4be10fce-95f0-40b4-a28f-034a391fafd3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:03:53.555939 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] [a973d65e-9bc3-4bb9-ab7c-0d2c967cb081] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 41542. Aug 03 19:03:53.691899 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4be10fce-95f0-40b4-a28f-034a391fafd3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.148011 Aug 03 19:03:53.692618 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 494/975] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 19:03:52 2022] POST /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments => generated 194 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:04:01.319121 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-980c0026-1ef6-4fa0-99e9-819ec7be13f5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: .version_select at 0x7fdac9e159d0>, body: {"keypair": {"name": "tempest-keypair-626861463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuCQAse9pfIwAb5pfuLQx8w1JjrMvi2xgcysiUYy0yw/Z6kAQfz6Glu3I7pPDyp73yLLUz53nEW5vZDRS+S6PNPolUPOJM5N2tJ084TrLm77KBDokKG4f6Db8wMiCgcmA=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:01.328391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:01.329700 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=4 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:01.340384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-980c0026-1ef6-4fa0-99e9-819ec7be13f5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:04:01.346557 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-980c0026-1ef6-4fa0-99e9-819ec7be13f5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:04:01.370889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-980c0026-1ef6-4fa0-99e9-819ec7be13f5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055632 Aug 03 19:04:01.371842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 482/976] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 19:04:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:03.398312 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:03.403691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1419612514", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7445c4-4df7-4e9a-ab26-f2a5eef98b34"}], "security_groups": [{"name": "tempest-securitygroup--2054934904"}], "key_name": "tempest-keypair-626861463", "user_data": "}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:03.576571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] validate_networks() for [('9b7445c4-4df7-4e9a-ab26-f2a5eef98b34', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:04:03.685025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:04.701941 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:04:04.703304 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:04:04.703964 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:04:04.705024 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:04:04.705770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:04:04.717523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.718330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.720086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:04.722233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:04.746481 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:04:04.752568 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:04:04.768332 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:04:04.771195 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:04:04.848274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8a6f449d-de7b-4a8b-a1eb-e1d491e80e26 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.448900 Aug 03 19:04:04.849443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 495/977] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:04:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:04:04.867685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9b24d2f0-4635-42c3-8759-93a0e3ceeefc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:04.869682 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9b24d2f0-4635-42c3-8759-93a0e3ceeefc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:04.963846 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9b24d2f0-4635-42c3-8759-93a0e3ceeefc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:04.971330 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9b24d2f0-4635-42c3-8759-93a0e3ceeefc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1241 microversion: 2.1 time: 0.114865 Aug 03 19:04:04.972168 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 483/978] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:04 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:05.993534 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:05.994241 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:06.001752 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:06.002274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:06.003071 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:06.003516 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:06.070426 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:06.078876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-099b7234-e5fc-4fcd-a03e-e804b96b4204 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1293 microversion: 2.1 time: 0.090207 Aug 03 19:04:06.079449 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 484/979] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:05 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:06.117007 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6f420937-ddfd-4c0e-baff-8022a72a9d57 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Action: 'create', calling method: .version_select at 0x7fdaca0b0550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-631434978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEGngS670+NLcF+0a8dS7DNR42jeYdfqEQqSole45uqZ5qBqBf0a+l/e9I44NUu8T0P0ozKq1nS3q93nxlpRZ15zIl+r0eG/jjoaSGyj45kOMg7TusofjVSSJwADo61Mg=="}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:06.133757 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-6f420937-ddfd-4c0e-baff-8022a72a9d57 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'key_pairs'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:04:06.138997 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-6f420937-ddfd-4c0e-baff-8022a72a9d57 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for user 4f7e62d82d054b98bd22dc6958577a74 and project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'key_pairs'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:04:06.165906 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6f420937-ddfd-4c0e-baff-8022a72a9d57 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.240427 Aug 03 19:04:06.166838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 496/980] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 19:04:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:07.099084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:07.100381 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:07.110895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:07.113111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.113111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:07.113111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:07.255905 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:07.266926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-11e0ce8f-c490-41c6-aceb-0e4afd9d2b54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1299 microversion: 2.1 time: 0.171627 Aug 03 19:04:07.273002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 485/981] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:07 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:08.299894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:08.300993 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:08.312903 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.316184 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.319609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.321230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.450226 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-160dd924-81e1-4632-9de1-09aac9e1d116 req-e6516e9a-a1f5-40c1-9f94-608c123974ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74508c60-b1e4-414d-ac03-4dba643bbba7", "tag": "985797d7-b6cb-4095-9d96-6f6066225bcb"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:08.477769 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-160dd924-81e1-4632-9de1-09aac9e1d116 req-e6516e9a-a1f5-40c1-9f94-608c123974ea service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:08.478528 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-160dd924-81e1-4632-9de1-09aac9e1d116 req-e6516e9a-a1f5-40c1-9f94-608c123974ea service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:08.499504 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-160dd924-81e1-4632-9de1-09aac9e1d116 req-e6516e9a-a1f5-40c1-9f94-608c123974ea service nova] Creating event network-changed:985797d7-b6cb-4095-9d96-6f6066225bcb for instance 74508c60-b1e4-414d-ac03-4dba643bbba7 on hv-cinder-85164 Aug 03 19:04:08.512472 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-160dd924-81e1-4632-9de1-09aac9e1d116 req-e6516e9a-a1f5-40c1-9f94-608c123974ea service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243418 Aug 03 19:04:08.513397 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 497/982] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:08.608816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:08.623282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bd7af4fa-4e0b-4654-a25c-35c73ae7e382 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.336540 Aug 03 19:04:08.623863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 486/983] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:08 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:09.645704 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:09.646407 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:09.653754 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:09.654076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:09.654972 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:09.655426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:09.789204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:09.797407 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-87e6e666-2dab-445f-9b41-3c761300a3c6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.156594 Aug 03 19:04:09.797967 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 498/984] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:09 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:10.818322 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:10.819009 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:10.826257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.826782 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:10.827660 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:10.828120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:10.973004 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:10.980482 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-15b3bf7f-55c8-4a8a-97fe-47f667fd2a25 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.166302 Aug 03 19:04:10.981268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 487/985] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:10 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:12.001504 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:12.002061 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:12.009095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:12.009638 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:12.010450 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:12.010889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:12.156197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:12.163916 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b6b5441f-3b03-4fd3-9850-cbf5f24d9115 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.167118 Aug 03 19:04:12.164514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 499/986] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:11 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:13.188026 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:13.188579 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:13.195385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:13.195837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:13.196646 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:13.197135 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:13.361899 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:13.370931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-61376821-577b-446d-b32f-b32ea274edaf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.187850 Aug 03 19:04:13.372329 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 488/987] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:13 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:14.393483 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:14.394084 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:14.400574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.401043 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.401794 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:14.402229 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:14.546655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:14.554054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e12a4565-956d-4114-b0e8-03f40ece8c1b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.164407 Aug 03 19:04:14.554627 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 500/988] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:14 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:15.298522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-84af9406-ca04-418e-8afd-78c4f1ba42f8 req-718b2371-60b7-4b52-bf06-77fa74b48dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74508c60-b1e4-414d-ac03-4dba643bbba7", "name": "network-vif-plugged", "status": "completed", "tag": "985797d7-b6cb-4095-9d96-6f6066225bcb"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:15.304526 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:15.312048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-84af9406-ca04-418e-8afd-78c4f1ba42f8 req-718b2371-60b7-4b52-bf06-77fa74b48dff service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:15.312557 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-84af9406-ca04-418e-8afd-78c4f1ba42f8 req-718b2371-60b7-4b52-bf06-77fa74b48dff service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:15.323741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-84af9406-ca04-418e-8afd-78c4f1ba42f8 req-718b2371-60b7-4b52-bf06-77fa74b48dff service nova] Creating event network-vif-plugged:985797d7-b6cb-4095-9d96-6f6066225bcb for instance 74508c60-b1e4-414d-ac03-4dba643bbba7 on hv-cinder-85164 Aug 03 19:04:15.329403 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-84af9406-ca04-418e-8afd-78c4f1ba42f8 req-718b2371-60b7-4b52-bf06-77fa74b48dff service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038743 Aug 03 19:04:15.330081 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 489/989] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:15.577280 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:15.579256 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:15.582129 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:15.589257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:15.589786 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:15.591907 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:15.592382 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:15.732867 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:15.740370 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-bc212e9b-60df-4cab-b773-804c4f1a1312 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.169245 Aug 03 19:04:15.740942 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 501/990] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:15 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:16.763402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:16.764014 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:16.770249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:16.770699 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:16.771471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:16.771910 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:16.916165 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:16.920938 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-28f9efc3-5b13-47da-986e-1d9caf7035ab tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1367 microversion: 2.1 time: 0.162690 Aug 03 19:04:16.921513 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 490/991] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:16 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:17.940534 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:17.941190 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:17.943113 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=10 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:17.949089 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:17.949556 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:17.950625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:17.951119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:18.096653 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:18.104625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f50252a3-6638-4f0c-8081-346cb4ddb8b8 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1557 microversion: 2.1 time: 0.167912 Aug 03 19:04:18.105194 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 502/992] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:17 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:18.126134 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4c24cf83-5c89-436d-8c23-939653905a30 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:18.126685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4c24cf83-5c89-436d-8c23-939653905a30 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:18.133839 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c24cf83-5c89-436d-8c23-939653905a30 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:18.134327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c24cf83-5c89-436d-8c23-939653905a30 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:18.135157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c24cf83-5c89-436d-8c23-939653905a30 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:18.135601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4c24cf83-5c89-436d-8c23-939653905a30 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:18.213461 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4c24cf83-5c89-436d-8c23-939653905a30 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091203 Aug 03 19:04:18.214083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 491/993] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 19:04:18 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:19.179033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-203507db-f5a9-4a40-a917-b1c6d290ff36 req-48f161a8-1372-48e1-8b3d-9016e4ad60b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74508c60-b1e4-414d-ac03-4dba643bbba7", "tag": "985797d7-b6cb-4095-9d96-6f6066225bcb"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:19.189561 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-203507db-f5a9-4a40-a917-b1c6d290ff36 req-48f161a8-1372-48e1-8b3d-9016e4ad60b3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:19.189933 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-203507db-f5a9-4a40-a917-b1c6d290ff36 req-48f161a8-1372-48e1-8b3d-9016e4ad60b3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:19.201451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-203507db-f5a9-4a40-a917-b1c6d290ff36 req-48f161a8-1372-48e1-8b3d-9016e4ad60b3 service nova] Creating event network-changed:985797d7-b6cb-4095-9d96-6f6066225bcb for instance 74508c60-b1e4-414d-ac03-4dba643bbba7 on hv-cinder-85164 Aug 03 19:04:19.206620 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-203507db-f5a9-4a40-a917-b1c6d290ff36 req-48f161a8-1372-48e1-8b3d-9016e4ad60b3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031286 Aug 03 19:04:19.207442 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 503/994] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:31.787643 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:31.788437 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=42 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:31.792620 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-528613916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-631434978", "security_groups": [{"name": "tempest-secgroup-smoke-833790757"}], "block_device_mapping_v2": [{"uuid": "f155b0d1-99be-4970-9e13-fcd73ba7f780", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dd4230a-823c-4cad-a550-19090f3c110c"}]}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:31.910891 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] validate_networks() for [('4dd4230a-823c-4cad-a550-19090f3c110c', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:04:32.356512 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:04:32.356919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:04:32.357409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:04:32.357806 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:04:32.358222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:04:32.367079 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.367533 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:32.368374 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:32.368816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:32.386918 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:04:32.391103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for user 4f7e62d82d054b98bd22dc6958577a74 and project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:04:32.449023 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:04:32.451222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f155b0d1-99be-4970-9e13-fcd73ba7f780',volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:04:32.584937 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-84fe3cdc-c321-4b6c-9737-c2c0f4828d6f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.798451 Aug 03 19:04:32.585601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 492/995] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:04:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:04:32.597697 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cb865368-342a-4857-aa2b-67dc198b257c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:32.598399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-cb865368-342a-4857-aa2b-67dc198b257c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:32.601850 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:32.602490 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=36 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:32.661530 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-cb865368-342a-4857-aa2b-67dc198b257c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:32.668889 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cb865368-342a-4857-aa2b-67dc198b257c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1093 microversion: 2.1 time: 0.074809 Aug 03 19:04:32.669549 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 504/996] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:32 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:33.539999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:33.540650 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:33.548367 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:33.548824 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:33.549607 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:33.550082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:33.573067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lazy-loading 'flavor' on Instance uuid f7e484cc-859c-4404-b392-b50dcc4cfc66 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:04:33.651723 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-18d69f30-b7a6-440a-866a-22b95a7a1af4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "POST /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66/action" status: 202 len: 0 microversion: 2.1 time: 0.115504 Aug 03 19:04:33.652648 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 493/997] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 19:04:33 2022] POST /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:04:33.664933 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:33.666173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:33.675467 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:33.675933 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:33.676737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:33.677350 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:33.691956 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:33.692858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:33.699431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:33.700266 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:33.702741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:33.703440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:33.800494 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:33.808219 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1b92a5f7-86f9-4875-9662-331a5c0952b2 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1209 microversion: 2.1 time: 0.120846 Aug 03 19:04:33.809031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 494/998] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:33 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:33.864197 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:33.872864 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ef38b022-2d2c-40bb-af63-e73e12a9fa8e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.213714 Aug 03 19:04:33.873451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 505/999] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:33 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:34.832980 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:34.833718 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:34.842930 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.844084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:34.845064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.845518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:34.897131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:34.897852 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:34.905261 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.905810 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:34.906680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:34.907194 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:35.057266 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:35.067013 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-52bca1de-0450-44f7-bdb7-f69720e62814 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1264 microversion: 2.1 time: 0.240749 Aug 03 19:04:35.067752 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 495/1000] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:34 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:35.088074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:35.096494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d32530ce-182b-4f42-b740-c2951c3644fd tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.205234 Aug 03 19:04:35.097073 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 506/1001] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:34 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:35.182423 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-7aba2b40-bca1-47f0-b158-73f1c8533a11 req-a37c3d1b-3973-4a54-806a-b8836c8f1c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2808354-602d-46bd-8f4b-1106aee02ad8", "tag": "10e76aa3-1ea7-496e-8864-fde1a041163d"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:35.194796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-7aba2b40-bca1-47f0-b158-73f1c8533a11 req-a37c3d1b-3973-4a54-806a-b8836c8f1c41 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:35.195325 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-7aba2b40-bca1-47f0-b158-73f1c8533a11 req-a37c3d1b-3973-4a54-806a-b8836c8f1c41 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:35.206219 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-7aba2b40-bca1-47f0-b158-73f1c8533a11 req-a37c3d1b-3973-4a54-806a-b8836c8f1c41 service nova] Creating event network-changed:10e76aa3-1ea7-496e-8864-fde1a041163d for instance b2808354-602d-46bd-8f4b-1106aee02ad8 on hv-cinder-85164 Aug 03 19:04:35.210912 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-7aba2b40-bca1-47f0-b158-73f1c8533a11 req-a37c3d1b-3973-4a54-806a-b8836c8f1c41 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032337 Aug 03 19:04:35.211573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 496/1002] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:36.087744 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:36.088381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:36.095476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.095932 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.096724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.097163 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.119215 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:36.119924 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:36.126913 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.127632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.128453 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:36.128893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:36.304117 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:36.313274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7b125cb5-0534-4c07-92ef-055670b02770 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1264 microversion: 2.1 time: 0.229285 Aug 03 19:04:36.313957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 507/1003] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:36 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:36.317825 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:36.326026 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-702c2482-fce7-4415-83a8-f61cfc3aa26e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.211468 Aug 03 19:04:36.326700 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 497/1004] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:36 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:37.333744 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:37.334394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:37.342216 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:37.342526 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:37.343362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:37.344010 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:37.347132 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:37.347758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:37.354226 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:37.354684 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:37.355460 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:37.356501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:37.551877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:37.555303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:37.559597 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-981bfa58-762f-47e2-94d3-1ac8801e9864 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1264 microversion: 2.1 time: 0.229766 Aug 03 19:04:37.560229 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 508/1005] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:37 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:37.563831 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e56073f8-13c8-4a41-8d27-b8213fc65ff4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.220462 Aug 03 19:04:37.564417 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 498/1006] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:37 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:38.581249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:38.582111 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:38.585444 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:38.586154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:38.588933 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.589702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.591334 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.592340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.593573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.594341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:38.595380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:38.596047 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:39.069897 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:39.077652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f7e32ef7-cc05-4ef7-87f4-a71baea85d07 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1264 microversion: 2.1 time: 0.501255 Aug 03 19:04:39.078430 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 509/1007] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:38 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1264 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:39.081469 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:39.089325 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b9455768-e362-4c59-88c2-11e467f9485e tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.507718 Aug 03 19:04:39.090471 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 499/1008] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:38 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:40.099883 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:40.100578 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:40.107659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:40.108120 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:40.108932 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:40.109377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:40.111523 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:40.112313 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:40.118872 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:40.119328 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:40.120159 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:40.120805 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:40.313703 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:40.321459 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c9559291-6c38-44ba-9dfe-f8f41b9db211 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1264 microversion: 2.1 time: 0.225627 Aug 03 19:04:40.322043 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 510/1009] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:40 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:40.327480 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:40.335155 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-28ef178d-50c0-4f4e-ab86-65eac8de173b tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.227820 Aug 03 19:04:40.335750 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 500/1010] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:40 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:41.344025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:41.345495 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:41.352610 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.353355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.354246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.354628 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.359387 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:41.361651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:41.369191 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.369651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.370609 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.371053 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.510272 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:41.519727 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7d8f5014-7cc7-4b6a-b426-afc7698aa801 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1264 microversion: 2.1 time: 0.180929 Aug 03 19:04:41.520705 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 511/1011] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:41 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:41.525854 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-dc4368c0-2b11-4b7c-bcf0-3fcd9671aa9d req-d47c5416-b453-4008-93af-48d3e2fa8020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2808354-602d-46bd-8f4b-1106aee02ad8", "name": "network-vif-plugged", "status": "completed", "tag": "10e76aa3-1ea7-496e-8864-fde1a041163d"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:41.537095 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-dc4368c0-2b11-4b7c-bcf0-3fcd9671aa9d req-d47c5416-b453-4008-93af-48d3e2fa8020 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:41.537621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-dc4368c0-2b11-4b7c-bcf0-3fcd9671aa9d req-d47c5416-b453-4008-93af-48d3e2fa8020 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:41.550567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-dc4368c0-2b11-4b7c-bcf0-3fcd9671aa9d req-d47c5416-b453-4008-93af-48d3e2fa8020 service nova] Creating event network-vif-plugged:10e76aa3-1ea7-496e-8864-fde1a041163d for instance b2808354-602d-46bd-8f4b-1106aee02ad8 on hv-cinder-85164 Aug 03 19:04:41.556310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-dc4368c0-2b11-4b7c-bcf0-3fcd9671aa9d req-d47c5416-b453-4008-93af-48d3e2fa8020 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Aug 03 19:04:41.556914 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 512/1012] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:41.669763 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:41.677323 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-127f70a4-25b0-42c8-9bee-1bb9923a9559 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.324847 Aug 03 19:04:41.677885 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 501/1013] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:41 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:42.542956 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:42.544460 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:42.551454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:42.551971 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:42.552845 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:42.553306 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:42.665936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:42.696461 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:42.698517 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:42.699418 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:42.702151 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:42.703213 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:42.705032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-18b4048e-f305-4ab9-b12d-ca7f9d9bef15 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1264 microversion: 2.1 time: 0.167264 Aug 03 19:04:42.710946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:42.711802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:42.712744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:42.713185 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:42.716577 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 513/1014] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:42 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:42.847475 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:42.854936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d690b065-8b40-4758-98f5-1a07961a3c09 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.160346 Aug 03 19:04:42.855503 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 502/1015] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:42 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:43.726254 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:43.726859 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:43.733715 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.734155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:43.734917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.735354 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:43.875999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:43.876726 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:43.878446 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:43.884041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.884593 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:43.885434 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.885940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:43.888302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b2e164f3-8aee-43f0-8b5f-29d2a190dc5f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1451 microversion: 2.1 time: 0.164722 Aug 03 19:04:43.888302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 514/1016] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:43 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:43.909330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:43.909747 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:43.915975 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.916595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:43.919957 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:43.921020 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:44.105981 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:44.114196 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-785ec85f-5f79-4bcd-ba3d-ba56137339d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.242080 Aug 03 19:04:44.114776 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 503/1017] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:43 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:44.169416 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:44.177200 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5a77e929-0f42-44cf-9a6a-107290a0d71a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1451 microversion: 2.1 time: 0.271871 Aug 03 19:04:44.177765 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 515/1018] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:43 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1451 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:45.138535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:45.139232 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:45.145934 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:45.146389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:45.147190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:45.147631 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:45.286865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:45.295387 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-eeb8ad3b-16ea-4ed2-bb6c-ae66b4a362d3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.161883 Aug 03 19:04:45.296391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 504/1019] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:45 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:45.849654 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-c8e2b795-e142-4d1b-9597-8d1d1b4ca2bf req-6742626f-d80f-42db-ad4d-1d5e53aaa4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2808354-602d-46bd-8f4b-1106aee02ad8", "tag": "10e76aa3-1ea7-496e-8864-fde1a041163d"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:45.861702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-c8e2b795-e142-4d1b-9597-8d1d1b4ca2bf req-6742626f-d80f-42db-ad4d-1d5e53aaa4d3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:45.862143 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-c8e2b795-e142-4d1b-9597-8d1d1b4ca2bf req-6742626f-d80f-42db-ad4d-1d5e53aaa4d3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:45.875007 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-c8e2b795-e142-4d1b-9597-8d1d1b4ca2bf req-6742626f-d80f-42db-ad4d-1d5e53aaa4d3 service nova] Creating event network-changed:10e76aa3-1ea7-496e-8864-fde1a041163d for instance b2808354-602d-46bd-8f4b-1106aee02ad8 on hv-cinder-85164 Aug 03 19:04:45.881742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-c8e2b795-e142-4d1b-9597-8d1d1b4ca2bf req-6742626f-d80f-42db-ad4d-1d5e53aaa4d3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036236 Aug 03 19:04:45.882633 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 516/1020] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:46.316154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:46.317003 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:46.325675 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:46.326144 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:46.326921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:46.327517 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:46.566915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:46.575388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6876a9f0-1a8e-4e42-99a5-d4e077718141 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.262545 Aug 03 19:04:46.588530 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 505/1021] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:46 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:47.599041 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:47.599745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:47.607243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.607695 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:47.608510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.608954 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:47.742296 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:47.750912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0423907e-71b8-4305-b230-f6013e8813f0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1508 microversion: 2.1 time: 0.156718 Aug 03 19:04:47.751477 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 517/1022] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:47 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:47.772159 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:47.772795 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:47.779614 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.780055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:47.780847 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.781278 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:47.810575 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129368) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 19:04:47.868376 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:47.884454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b932ea63-cec7-4309-87cc-e4b38f43fbc3 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "POST /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66/action" status: 202 len: 0 microversion: 2.1 time: 0.116023 Aug 03 19:04:47.885082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 506/1023] 10.222.0.69 () {60 vars in 1278 bytes} [Wed Aug 3 19:04:47 2022] POST /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:04:47.893805 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:47.894527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:47.900907 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.901436 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:47.902390 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:47.903323 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:48.042438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:48.050224 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b32a682b-67a2-4d85-849a-2eae601b09ee tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1516 microversion: 2.1 time: 0.160241 Aug 03 19:04:48.050801 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 518/1024] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:47 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:04:49.071431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:49.072115 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:49.079895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:49.080380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:49.081218 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:49.081719 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:49.218363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:49.225960 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-18790067-8449-4a5e-8735-959da0d0e043 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1518 microversion: 2.1 time: 0.158405 Aug 03 19:04:49.226528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 507/1025] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:49 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:49.438528 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-11df51c1-ff43-44de-b07f-c704acb6f4df req-1197ff1f-d229-43cf-ae89-9950ff57f2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e484cc-859c-4404-b392-b50dcc4cfc66", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6ca9cd-b14a-4853-9072-8075423e62ae"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:04:49.449899 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-11df51c1-ff43-44de-b07f-c704acb6f4df req-1197ff1f-d229-43cf-ae89-9950ff57f2bd service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:49.450348 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-11df51c1-ff43-44de-b07f-c704acb6f4df req-1197ff1f-d229-43cf-ae89-9950ff57f2bd service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:49.462275 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-11df51c1-ff43-44de-b07f-c704acb6f4df req-1197ff1f-d229-43cf-ae89-9950ff57f2bd service nova] Creating event network-vif-unplugged:ee6ca9cd-b14a-4853-9072-8075423e62ae for instance f7e484cc-859c-4404-b392-b50dcc4cfc66 on hv-cinder-85164 Aug 03 19:04:49.468359 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-11df51c1-ff43-44de-b07f-c704acb6f4df req-1197ff1f-d229-43cf-ae89-9950ff57f2bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034369 Aug 03 19:04:49.468963 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 519/1026] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:04:50.249214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:50.249826 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:50.256200 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:50.256682 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:50.257704 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:50.258197 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:50.398055 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:50.405797 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b77c9d26-1c77-4b1c-8820-c9acbe01cb50 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.161144 Aug 03 19:04:50.406369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 508/1027] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:50 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:51.428602 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:51.429356 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:51.436756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:51.437213 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:51.437988 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:51.438433 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:51.572324 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:51.580421 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e44c7593-55d4-4da6-a72f-b96665fc189a tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.156503 Aug 03 19:04:51.580992 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 520/1028] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:51 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:52.602373 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:52.603084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:52.610489 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:52.610979 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:52.611819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:52.612337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:52.749253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:52.756688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6a22b2ad-1c57-4f0b-8277-9737d22f9548 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.158492 Aug 03 19:04:52.757249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 509/1029] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:52 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:53.778993 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:53.779608 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:53.785731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:53.786177 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:53.786955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:53.787367 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:53.920561 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:53.927983 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-824f4910-7ef5-42f1-aea3-e73377ee9152 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.153506 Aug 03 19:04:53.928731 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 521/1030] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:53 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:54.950065 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:54.950771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:54.957623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:54.958002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:54.958800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:54.959242 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:55.099745 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:55.107511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a1275a51-9e1f-4c5e-8ef1-5d09188f4db4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.161426 Aug 03 19:04:55.108090 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 510/1031] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:54 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:56.129330 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:56.129902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:56.137983 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:56.138443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:56.139224 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:56.139759 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:56.272925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:56.280458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a066639b-3b6b-48e4-a1bd-912d51761c49 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.155145 Aug 03 19:04:56.281033 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 522/1032] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:56 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:57.301619 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:57.302175 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:57.309827 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:57.310091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:57.310867 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:57.311305 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:57.444015 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:57.451894 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9cb85c75-6ed7-471d-b31c-b77d8371aab1 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.154250 Aug 03 19:04:57.452710 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 511/1033] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:57 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:58.472987 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:58.473609 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:58.480359 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:58.480794 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:58.481559 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:58.481998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:58.500658 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=100 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:04:58.617660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:58.626220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e0072498-e90c-47e9-8398-9aabbbb37b7c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.157111 Aug 03 19:04:58.626787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 523/1034] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:58 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:04:59.647783 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:04:59.648452 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:04:59.656754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:59.657243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:59.657928 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:04:59.658378 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:04:59.794112 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:04:59.801989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c0ea3c7e-098a-4f23-9f49-abe6f5b5e970 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.158130 Aug 03 19:04:59.802936 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 512/1035] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:04:59 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:00.835154 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:00.835764 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:00.842835 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:00.843281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:00.844038 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:00.844510 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:00.979885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:00.987863 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2e4a8349-e637-48b0-bd70-c38cd82e019c tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.156753 Aug 03 19:05:00.988451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 524/1036] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:00 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:01.702065 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-6616ea01-d01d-4ad8-b9a8-81593ba06756 req-f239d780-fd21-4d18-9ee7-f883cb68b5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e484cc-859c-4404-b392-b50dcc4cfc66", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ca9cd-b14a-4853-9072-8075423e62ae"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:01.714215 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-6616ea01-d01d-4ad8-b9a8-81593ba06756 req-f239d780-fd21-4d18-9ee7-f883cb68b5fb service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:01.715910 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-6616ea01-d01d-4ad8-b9a8-81593ba06756 req-f239d780-fd21-4d18-9ee7-f883cb68b5fb service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:01.726745 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-6616ea01-d01d-4ad8-b9a8-81593ba06756 req-f239d780-fd21-4d18-9ee7-f883cb68b5fb service nova] Creating event network-vif-plugged:ee6ca9cd-b14a-4853-9072-8075423e62ae for instance f7e484cc-859c-4404-b392-b50dcc4cfc66 on hv-cinder-85164 Aug 03 19:05:01.732104 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-6616ea01-d01d-4ad8-b9a8-81593ba06756 req-f239d780-fd21-4d18-9ee7-f883cb68b5fb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035475 Aug 03 19:05:01.732733 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 513/1037] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:05:02.008690 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:02.009310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:02.016796 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:02.017447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:02.020437 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:02.020902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:02.177880 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:02.186413 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-78ae47b2-ec66-4684-9075-9cb8223c771f tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.181925 Aug 03 19:05:02.186898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 525/1038] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:02 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:03.208877 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:03.209713 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:03.212256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:03.218211 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:03.218668 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:03.219461 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:03.219895 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:03.359850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:03.367311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-fe98f8e0-2490-432b-a1ff-d43936e1b2e4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1574 microversion: 2.1 time: 0.162749 Aug 03 19:05:03.367865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 514/1039] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:03 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:04.390222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:04.390847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:04.393267 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=47 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:04.398612 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:04.399063 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:04.399861 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:04.400373 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:04.531590 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:04.539131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7ce03916-48d9-42d9-8367-5c205094d582 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1561 microversion: 2.1 time: 0.153563 Aug 03 19:05:04.539709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 526/1040] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:04 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:46.809235 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ed158633-632b-4868-abb5-4bab6d0dc07d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:46.809853 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-ed158633-632b-4868-abb5-4bab6d0dc07d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:46.811920 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:46.812742 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=44 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:46.818352 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed158633-632b-4868-abb5-4bab6d0dc07d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:46.818802 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed158633-632b-4868-abb5-4bab6d0dc07d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:46.819572 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed158633-632b-4868-abb5-4bab6d0dc07d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:46.820011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-ed158633-632b-4868-abb5-4bab6d0dc07d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:46.844244 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ed158633-632b-4868-abb5-4bab6d0dc07d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7/ips" status: 200 len: 150 microversion: 2.1 time: 0.039175 Aug 03 19:05:46.844829 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 515/1041] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 19:05:46 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:05:46.856888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d7be18f-8f43-4635-8ba9-4a88d114db79"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:46.859839 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:46.862057 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:46.862713 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=20 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:05:46.868936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:46.869390 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:46.870168 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:46.870607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:47.048952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Invalid volume: volume 5d7be18f-8f43-4635-8ba9-4a88d114db79 is already attached to instances: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: POST /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7/os-volume_attachments HTTP/1.1 Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 74 Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:05:47.050678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {"volumeAttachment": {"volumeId": "5d7be18f-8f43-4635-8ba9-4a88d114db79"}} Aug 03 19:05:47.052443 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Invalid volume: volume 5d7be18f-8f43-4635-8ba9-4a88d114db79 is already attached to instances: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'server_id': '74508c60-b1e4-414d-ac03-4dba643bbba7', 'body': {'volumeAttachment': {'volumeId': '5d7be18f-8f43-4635-8ba9-4a88d114db79'}}} Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5d7be18f-8f43-4635-8ba9-4a88d114db79 is already attached to instances: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:47.053648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5d7be18f-8f43-4635-8ba9-4a88d114db79 is already attached to instances: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:47.055242 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5d7be18f-8f43-4635-8ba9-4a88d114db79 is already attached to instances: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 400 to user: Invalid volume: volume 5d7be18f-8f43-4635-8ba9-4a88d114db79 is already attached to instances: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9ac860bc-f306-4bcc-b724-045a44fa9ed7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.200118 Aug 03 19:05:47.057004 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 527/1042] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 19:05:46 2022] POST /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7/os-volume_attachments => generated 174 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:05:47.061734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:47.062243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:47.068145 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:47.068646 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:47.069411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:47.069853 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:47.094246 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:05:47.172248 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-460679cf-ecb7-4f2e-811a-f30c6d42d192 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 204 len: 0 microversion: 2.1 time: 0.114586 Aug 03 19:05:47.172929 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 516/1043] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:05:47 2022] DELETE /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 19:05:47.182579 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:47.184048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:47.191297 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:47.191743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:47.192527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:47.192960 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:47.327636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:47.335158 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-40df6ebe-8ea6-43d1-bc52-099c299a54d5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1682 microversion: 2.1 time: 0.157666 Aug 03 19:05:47.335727 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 528/1044] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:47 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:48.359550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:48.360255 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:48.366988 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:48.367442 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:48.368212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:48.368682 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:48.549478 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:48.556855 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0292af24-4403-44ed-94c8-026ef06c2a3f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1682 microversion: 2.1 time: 0.202423 Aug 03 19:05:48.557408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 517/1045] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:48 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:49.578798 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:49.579636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:49.585566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:49.586011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:49.586770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:49.587204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:49.799782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:49.807427 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-922ee774-9301-4117-96bc-88ff3f7398ef tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 200 len: 1682 microversion: 2.1 time: 0.233534 Aug 03 19:05:49.808220 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 529/1046] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:49 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:50.149086 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-a80a03bc-1006-4131-91bd-8a68a1929353 req-ead212be-afdd-4907-a522-b3d259e1ddc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74508c60-b1e4-414d-ac03-4dba643bbba7", "name": "network-vif-deleted", "tag": "985797d7-b6cb-4095-9d96-6f6066225bcb"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:50.160378 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-a80a03bc-1006-4131-91bd-8a68a1929353 req-ead212be-afdd-4907-a522-b3d259e1ddc3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:50.161149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-a80a03bc-1006-4131-91bd-8a68a1929353 req-ead212be-afdd-4907-a522-b3d259e1ddc3 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:50.173420 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-a80a03bc-1006-4131-91bd-8a68a1929353 req-ead212be-afdd-4907-a522-b3d259e1ddc3 service nova] Creating event network-vif-deleted:985797d7-b6cb-4095-9d96-6f6066225bcb for instance 74508c60-b1e4-414d-ac03-4dba643bbba7 on hv-cinder-85164 Aug 03 19:05:50.179725 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-a80a03bc-1006-4131-91bd-8a68a1929353 req-ead212be-afdd-4907-a522-b3d259e1ddc3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035742 Aug 03 19:05:50.180335 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 518/1047] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:05:50.829652 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:50.830458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:50.836943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:50.837462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:50.838222 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:50.838654 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:50.852276 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 HTTP/1.1 Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:05:50.853856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:05:50.855811 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '74508c60-b1e4-414d-ac03-4dba643bbba7'} Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:05:50.856823 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:05:50.858435 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:05:50.859876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:05:50.859876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-dde074bc-ae5b-4be1-88b2-52a4fe05cbf5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 404 len: 111 microversion: 2.1 time: 0.029577 Aug 03 19:05:50.859876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 530/1048] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:50 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:05:50.869320 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a783eadc-b2cf-4eef-be56-f3e5b3f62a17 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '.version_select at 0x7fdac9e24f70>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:50.891749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a783eadc-b2cf-4eef-be56-f3e5b3f62a17 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626861463" status: 202 len: 0 microversion: 2.1 time: 0.026547 Aug 03 19:05:50.892481 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 519/1049] 10.222.0.69 () {58 vars in 1218 bytes} [Wed Aug 3 19:05:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626861463 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:05:51.851504 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:51.852038 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:51.858885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:51.859335 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:51.860099 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:51.860562 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:51.943907 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lazy-loading 'services' on Instance uuid a1630d33-81ce-4d63-ad4e-bd5d1eb5359d {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:05:52.017655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-0fb3c25d-751c-41b5-a123-2df2c2689e5d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments/5d7be18f-8f43-4635-8ba9-4a88d114db79" status: 202 len: 0 microversion: 2.1 time: 0.169888 Aug 03 19:05:52.018273 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 531/1050] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 19:05:51 2022] DELETE /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments/5d7be18f-8f43-4635-8ba9-4a88d114db79 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:05:52.027625 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c500e234-427f-4cad-ac58-9b0075c4b566 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:52.029899 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c500e234-427f-4cad-ac58-9b0075c4b566 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:52.036764 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c500e234-427f-4cad-ac58-9b0075c4b566 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:52.037208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c500e234-427f-4cad-ac58-9b0075c4b566 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:52.038131 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c500e234-427f-4cad-ac58-9b0075c4b566 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:52.038569 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c500e234-427f-4cad-ac58-9b0075c4b566 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:52.068952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c500e234-427f-4cad-ac58-9b0075c4b566 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Aug 03 19:05:52.069574 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 520/1051] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:05:52 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:05:53.082230 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2c0e5359-9f58-4a38-a43d-85ce72b02beb tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:53.084659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2c0e5359-9f58-4a38-a43d-85ce72b02beb tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:53.091632 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c0e5359-9f58-4a38-a43d-85ce72b02beb tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:53.092088 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c0e5359-9f58-4a38-a43d-85ce72b02beb tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:53.092906 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c0e5359-9f58-4a38-a43d-85ce72b02beb tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:53.093351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2c0e5359-9f58-4a38-a43d-85ce72b02beb tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:53.123766 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2c0e5359-9f58-4a38-a43d-85ce72b02beb tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Aug 03 19:05:53.124356 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 532/1052] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:05:53 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:05:54.138313 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3f257e47-82e4-4c53-98fd-9fc1f151c5c5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:54.140502 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3f257e47-82e4-4c53-98fd-9fc1f151c5c5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:54.147296 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3f257e47-82e4-4c53-98fd-9fc1f151c5c5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:54.147754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3f257e47-82e4-4c53-98fd-9fc1f151c5c5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:54.148577 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3f257e47-82e4-4c53-98fd-9fc1f151c5c5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:54.149018 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3f257e47-82e4-4c53-98fd-9fc1f151c5c5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:54.181473 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3f257e47-82e4-4c53-98fd-9fc1f151c5c5 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048080 Aug 03 19:05:54.182048 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 521/1053] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:05:54 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:05:54.244098 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:54.244642 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:54.251561 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:54.252015 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:54.252820 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:54.253263 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:54.277787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:05:54.356187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2d114089-de4b-4b58-98f4-36fae5e6e70d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 204 len: 0 microversion: 2.1 time: 0.114787 Aug 03 19:05:54.357165 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 533/1054] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:05:54 2022] DELETE /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:05:54.365646 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:54.366301 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:54.373096 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:54.373549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:54.374318 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:54.374759 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:54.506909 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:54.515253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-619ba89d-601d-40ad-94fe-8c1b794f312f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1683 microversion: 2.1 time: 0.153495 Aug 03 19:05:54.515825 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 522/1055] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:54 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:55.538257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:55.538961 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:55.547005 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:55.547461 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:55.548237 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:55.548709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:55.683202 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:55.691344 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-e663afd2-7e93-4703-8ebd-807d1aa086d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1683 microversion: 2.1 time: 0.157415 Aug 03 19:05:55.691917 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 534/1056] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:55 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:56.713117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:56.713667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:56.720873 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:56.721332 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:56.722109 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:56.722543 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:56.947465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:05:56.955103 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-6326b266-e5d4-4bb7-b0f8-375de4cdb9d3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 200 len: 1683 microversion: 2.1 time: 0.245879 Aug 03 19:05:56.955683 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 523/1057] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:56 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 1683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:05:57.342496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-bd4c3dba-8115-4834-b20f-22ed07038b5d req-8d37c6ac-43be-44ee-9952-878abeb8b579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1630d33-81ce-4d63-ad4e-bd5d1eb5359d", "name": "network-vif-deleted", "tag": "57ecbc9b-315d-4270-9735-de2f9f63e6b1"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:57.355001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-bd4c3dba-8115-4834-b20f-22ed07038b5d req-8d37c6ac-43be-44ee-9952-878abeb8b579 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:57.355988 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-bd4c3dba-8115-4834-b20f-22ed07038b5d req-8d37c6ac-43be-44ee-9952-878abeb8b579 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:57.369605 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-bd4c3dba-8115-4834-b20f-22ed07038b5d req-8d37c6ac-43be-44ee-9952-878abeb8b579 service nova] Creating event network-vif-deleted:57ecbc9b-315d-4270-9735-de2f9f63e6b1 for instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d on hv-cinder-85164 Aug 03 19:05:57.376574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-bd4c3dba-8115-4834-b20f-22ed07038b5d req-8d37c6ac-43be-44ee-9952-878abeb8b579 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038949 Aug 03 19:05:57.377677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 535/1058] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:05:57.977554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:57.978209 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:05:57.985614 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:57.986068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:57.986843 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:05:57.987282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:05:58.001600 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d HTTP/1.1 Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:05:58.003267 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:05:58.004992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'a1630d33-81ce-4d63-ad4e-bd5d1eb5359d'} Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:05:58.005833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:05:58.009153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:05:58.012354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:05:58.012354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-38bfd1bd-9f67-41e5-b7f8-16cd27021f53 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 404 len: 111 microversion: 2.1 time: 0.031084 Aug 03 19:05:58.012354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 524/1059] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:05:57 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:05:58.015211 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-774573a2-9af6-47d5-8dff-3e619c09ed3b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '.version_select at 0x7fdaca215550>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:05:58.034940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-774573a2-9af6-47d5-8dff-3e619c09ed3b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533332650" status: 202 len: 0 microversion: 2.1 time: 0.024554 Aug 03 19:05:58.035529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 536/1060] 10.222.0.69 () {58 vars in 1221 bytes} [Wed Aug 3 19:05:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533332650 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:05:58.696803 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-21e57768-a00f-4cd0-83e5-beed8ee0ce21 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: .version_select at 0x7fdac9de9430>, body: {"keypair": {"name": "tempest-keypair-148847847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+ga49rjNdykB7KezCdRoWorzn2vE8pW7Ki9cJfw4SF/uczx6DVMtmK+teBGtMnnYxOKyLmf3k+HcrUGott5PnqsUxanKyk+KytcYXHXucMK77W48njvcISHqdymMrNjw=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:05:58.712357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-21e57768-a00f-4cd0-83e5-beed8ee0ce21 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:05:58.716528 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-21e57768-a00f-4cd0-83e5-beed8ee0ce21 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:05:58.740447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-21e57768-a00f-4cd0-83e5-beed8ee0ce21 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047376 Aug 03 19:05:58.741050 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 525/1061] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 19:05:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:00.044526 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1951069781", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7445c4-4df7-4e9a-ab26-f2a5eef98b34"}], "security_groups": [{"name": "tempest-securitygroup--214970470"}], "key_name": "tempest-keypair-148847847", "user_data": "}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:00.150283 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] validate_networks() for [('9b7445c4-4df7-4e9a-ab26-f2a5eef98b34', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:06:00.526074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:06:00.526502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:06:00.527655 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:06:00.529692 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:06:00.529692 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:06:00.537931 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:00.538377 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:00.539172 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:00.539606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:00.562420 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:06:00.565489 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:06:00.576918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:06:00.579250 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:06:00.630958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5e4108eb-3b4f-4421-9e3b-62eded13d40d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.591493 Aug 03 19:06:00.637752 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 537/1062] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:06:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:06:00.643638 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-48e2f139-fcbb-4d72-b449-c40be1cf06e6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:00.644389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-48e2f139-fcbb-4d72-b449-c40be1cf06e6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:00.705074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-48e2f139-fcbb-4d72-b449-c40be1cf06e6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:00.711722 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-48e2f139-fcbb-4d72-b449-c40be1cf06e6 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1241 microversion: 2.1 time: 0.072541 Aug 03 19:06:00.712307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 526/1063] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:00 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:01.736867 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:01.737486 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:01.743761 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:01.744212 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:01.745013 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:01.745796 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:01.828410 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:01.836108 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a6789a25-42db-45e7-ba39-9d76bf9d852e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1311 microversion: 2.1 time: 0.103574 Aug 03 19:06:01.836746 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 538/1064] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:01 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:02.858162 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:02.858792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:02.865601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:02.866120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:02.866959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:02.867467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:03.082083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:03.090085 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b17b20a3-dee6-4e0d-8869-2d42f680ce27 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1366 microversion: 2.1 time: 0.236089 Aug 03 19:06:03.090673 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 527/1065] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:02 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:03.268738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-4fcd5689-1b5c-4306-a21b-920874d0ab37 req-fa29a889-eb42-4f5b-9771-6e4a1a9284b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b5663e-9397-401d-ae02-702f90396e9d", "tag": "8736ad67-a248-4dd5-b91e-6b34f182bd1e"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:03.280940 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-4fcd5689-1b5c-4306-a21b-920874d0ab37 req-fa29a889-eb42-4f5b-9771-6e4a1a9284b8 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:03.281415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-4fcd5689-1b5c-4306-a21b-920874d0ab37 req-fa29a889-eb42-4f5b-9771-6e4a1a9284b8 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:03.293509 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-4fcd5689-1b5c-4306-a21b-920874d0ab37 req-fa29a889-eb42-4f5b-9771-6e4a1a9284b8 service nova] Creating event network-changed:8736ad67-a248-4dd5-b91e-6b34f182bd1e for instance 06b5663e-9397-401d-ae02-702f90396e9d on hv-cinder-85164 Aug 03 19:06:03.298455 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-4fcd5689-1b5c-4306-a21b-920874d0ab37 req-fa29a889-eb42-4f5b-9771-6e4a1a9284b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033353 Aug 03 19:06:03.299361 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 539/1066] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:04.111690 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:04.112264 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:04.118840 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:04.119292 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:04.120092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:04.121092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:04.255728 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:04.264598 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-420401e9-2428-4c15-9b54-1e1c8018b098 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1366 microversion: 2.1 time: 0.157098 Aug 03 19:06:04.265169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 528/1067] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:04 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:05.285959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:05.286666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:05.293648 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:05.294103 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:05.294873 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:05.295316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:05.430081 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:05.438256 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5d3de912-830d-4dfe-95c5-28017002a32d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1366 microversion: 2.1 time: 0.157089 Aug 03 19:06:05.438839 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 540/1068] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:05 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:06.458651 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:06.459281 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:06.466817 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:06.467268 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:06.468063 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:06.468539 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:06.603307 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:06.610745 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-24b2119a-03ab-4644-8e33-6435bfc7ac12 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1366 microversion: 2.1 time: 0.155949 Aug 03 19:06:06.611312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 529/1069] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:06 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:07.632455 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:07.633054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:07.640653 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:07.641104 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:07.641876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:07.642338 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:07.774105 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:07.782042 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-22a5a197-499f-4e9a-85ee-763b823b9691 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1366 microversion: 2.1 time: 0.153417 Aug 03 19:06:07.782621 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 541/1070] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:07 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:08.032394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-8df82e09-d993-4aca-a336-38f7e068c8f3 req-54131369-0aad-4950-9d45-a6a5377ffcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b5663e-9397-401d-ae02-702f90396e9d", "name": "network-vif-plugged", "status": "completed", "tag": "8736ad67-a248-4dd5-b91e-6b34f182bd1e"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:08.043550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8df82e09-d993-4aca-a336-38f7e068c8f3 req-54131369-0aad-4950-9d45-a6a5377ffcfc service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:08.043957 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8df82e09-d993-4aca-a336-38f7e068c8f3 req-54131369-0aad-4950-9d45-a6a5377ffcfc service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:08.057211 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-8df82e09-d993-4aca-a336-38f7e068c8f3 req-54131369-0aad-4950-9d45-a6a5377ffcfc service nova] Creating event network-vif-plugged:8736ad67-a248-4dd5-b91e-6b34f182bd1e for instance 06b5663e-9397-401d-ae02-702f90396e9d on hv-cinder-85164 Aug 03 19:06:08.063767 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-8df82e09-d993-4aca-a336-38f7e068c8f3 req-54131369-0aad-4950-9d45-a6a5377ffcfc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035931 Aug 03 19:06:08.064378 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 530/1071] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:08.804060 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:08.804704 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:08.812992 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:08.813438 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:08.814204 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:08.814636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:08.958445 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:08.966458 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ebc75ac7-e565-44d6-a706-add81907c31f tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1366 microversion: 2.1 time: 0.167757 Aug 03 19:06:08.967025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 542/1072] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:08 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:09.988272 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:09.988989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:09.995179 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:09.996298 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:09.997062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:09.997497 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:10.141645 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:10.149992 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-860dbf7a-a014-435a-afbc-d6f50938d90e tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1366 microversion: 2.1 time: 0.166328 Aug 03 19:06:10.150580 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 531/1073] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:09 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:11.172339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:11.172990 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:11.175383 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:11.176132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:11.182637 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:11.183166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:11.183955 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:11.184420 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:11.316882 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:11.324408 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-640af1b6-68aa-4d65-a3d4-113b80ef1e91 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1556 microversion: 2.1 time: 0.155965 Aug 03 19:06:11.324980 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 543/1074] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:11 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:11.344734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d71e17b4-d628-434a-a9e6-b5f32151ff54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:11.345354 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d71e17b4-d628-434a-a9e6-b5f32151ff54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:11.347121 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:11.352733 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d71e17b4-d628-434a-a9e6-b5f32151ff54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:11.353180 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d71e17b4-d628-434a-a9e6-b5f32151ff54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:11.353937 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d71e17b4-d628-434a-a9e6-b5f32151ff54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:11.354366 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d71e17b4-d628-434a-a9e6-b5f32151ff54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:11.436995 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d71e17b4-d628-434a-a9e6-b5f32151ff54 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096055 Aug 03 19:06:11.437586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 532/1075] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 19:06:11 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:12.697977 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-54ef6f02-d65b-43bc-bdca-83ee39aff032 req-2f2ecb0b-4984-4cc4-8e65-6d1c4b5b9250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b5663e-9397-401d-ae02-702f90396e9d", "tag": "8736ad67-a248-4dd5-b91e-6b34f182bd1e"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:12.710347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-54ef6f02-d65b-43bc-bdca-83ee39aff032 req-2f2ecb0b-4984-4cc4-8e65-6d1c4b5b9250 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:12.710832 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-54ef6f02-d65b-43bc-bdca-83ee39aff032 req-2f2ecb0b-4984-4cc4-8e65-6d1c4b5b9250 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:12.724339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-54ef6f02-d65b-43bc-bdca-83ee39aff032 req-2f2ecb0b-4984-4cc4-8e65-6d1c4b5b9250 service nova] Creating event network-changed:8736ad67-a248-4dd5-b91e-6b34f182bd1e for instance 06b5663e-9397-401d-ae02-702f90396e9d on hv-cinder-85164 Aug 03 19:06:12.729732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-54ef6f02-d65b-43bc-bdca-83ee39aff032 req-2f2ecb0b-4984-4cc4-8e65-6d1c4b5b9250 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035475 Aug 03 19:06:12.730698 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 544/1076] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:42.837190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:42.838713 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:42.845218 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:42.845956 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:06:42.858020 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:42.858540 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:42.876890 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:42.877358 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:42.878448 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:42.878893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:42.909650 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-b42b3de2-28c5-4d80-ba7e-29eb1a08cd6e req-76b2353d-4c76-40b8-be5f-7d45ec42e5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e484cc-859c-4404-b392-b50dcc4cfc66", "tag": "ee6ca9cd-b14a-4853-9072-8075423e62ae"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:42.919404 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:06:42.927027 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b42b3de2-28c5-4d80-ba7e-29eb1a08cd6e req-76b2353d-4c76-40b8-be5f-7d45ec42e5a6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:42.927585 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-b42b3de2-28c5-4d80-ba7e-29eb1a08cd6e req-76b2353d-4c76-40b8-be5f-7d45ec42e5a6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:42.944026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-b42b3de2-28c5-4d80-ba7e-29eb1a08cd6e req-76b2353d-4c76-40b8-be5f-7d45ec42e5a6 service nova] Creating event network-changed:ee6ca9cd-b14a-4853-9072-8075423e62ae for instance f7e484cc-859c-4404-b392-b50dcc4cfc66 on hv-cinder-85164 Aug 03 19:06:42.950601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-b42b3de2-28c5-4d80-ba7e-29eb1a08cd6e req-76b2353d-4c76-40b8-be5f-7d45ec42e5a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110113 Aug 03 19:06:42.951526 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 545/1077] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:06:43.006337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-71d84097-c84e-487a-8380-8ec217aa1d69 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "DELETE /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 204 len: 0 microversion: 2.1 time: 0.170243 Aug 03 19:06:43.007083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 533/1078] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:06:42 2022] DELETE /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:06:43.022072 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:43.022898 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:43.037164 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:43.037986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:43.039381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:43.040187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:43.195185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:43.203523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f0f11ecf-5247-450c-819a-60cfc1c2e135 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.189822 Aug 03 19:06:43.204093 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 546/1079] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:43 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:44.226597 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:44.227336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:44.234393 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:44.234852 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:44.235659 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:44.236099 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:44.424084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:44.431611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8029d1e8-e46c-411e-a74d-2d7d9fb608b6 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1567 microversion: 2.1 time: 0.209468 Aug 03 19:06:44.432172 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 534/1080] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:44 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:45.366381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-e4e16d72-defd-4ef8-8615-b5ae00af5b50 req-703e66f1-b89b-41ae-bec9-7155eac47634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e484cc-859c-4404-b392-b50dcc4cfc66", "name": "network-vif-deleted", "tag": "ee6ca9cd-b14a-4853-9072-8075423e62ae"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:06:45.379032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-e4e16d72-defd-4ef8-8615-b5ae00af5b50 req-703e66f1-b89b-41ae-bec9-7155eac47634 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:45.379415 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-e4e16d72-defd-4ef8-8615-b5ae00af5b50 req-703e66f1-b89b-41ae-bec9-7155eac47634 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:45.391523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-e4e16d72-defd-4ef8-8615-b5ae00af5b50 req-703e66f1-b89b-41ae-bec9-7155eac47634 service nova] Creating event network-vif-deleted:ee6ca9cd-b14a-4853-9072-8075423e62ae for instance f7e484cc-859c-4404-b392-b50dcc4cfc66 on hv-cinder-85164 Aug 03 19:06:45.397096 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-e4e16d72-defd-4ef8-8615-b5ae00af5b50 req-703e66f1-b89b-41ae-bec9-7155eac47634 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034430 Aug 03 19:06:45.397885 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 547/1081] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:06:45.452883 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:45.453502 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:45.460031 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:45.460656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:45.461627 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:45.461830 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:45.526754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84fe9ee2c5d48868d73ae651e253f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00e10f7a413422dba1ab74ef86e0946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:06:45.534391 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-7cb930ae-5ba5-4a30-ba26-464fbd42849d tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 200 len: 1218 microversion: 2.1 time: 0.085393 Aug 03 19:06:45.534961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 535/1082] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:45 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:06:46.555847 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:46.556505 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] [instance: f7e484cc-859c-4404-b392-b50dcc4cfc66] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:06:46.563518 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:46.563975 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:46.564788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:06:46.565228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:06:46.578406 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] HTTP exception thrown: Instance f7e484cc-859c-4404-b392-b50dcc4cfc66 could not be found. Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Request method failure captured: Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 HTTP/1.1 Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sXbxJLUHLVAsNY2W5PtPmF_a82-Zv2wQdyIHfkenf-mSwDY-57kKaqyKDohlxkzfbVZDSOc3aCHqGLE1ew8pkKuSMUhqUNYuguNI1A7uQXR_I0e-ndEesxXvgWFhgMH_afQ5KnT9paRBhKa5EURKP3yz03sr7ekGA4DnDGX85ymntY Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: c00e10f7a413422dba1ab74ef86e0946 Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-TestShelveInstance-1328465601 Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:06:46.580026 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c00e10f7a413422dba1ab74ef86e0946"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c00e10f7a413422dba1ab74ef86e0946"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c00e10f7a413422dba1ab74ef86e0946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c00e10f7a413422dba1ab74ef86e0946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-TestShelveInstance-1328465601 Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: c00e10f7a413422dba1ab74ef86e0946 Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-TestShelveInstance-1328465601 Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-TestShelveInstance-1328465601-project Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: f84fe9ee2c5d48868d73ae651e253f9e Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-TestShelveInstance-1328465601-project Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance f7e484cc-859c-4404-b392-b50dcc4cfc66 could not be found. Aug 03 19:06:46.581745 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'f7e484cc-859c-4404-b392-b50dcc4cfc66'} Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e484cc-859c-4404-b392-b50dcc4cfc66 could not be found. Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:06:46.582830 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e484cc-859c-4404-b392-b50dcc4cfc66 could not be found. Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e484cc-859c-4404-b392-b50dcc4cfc66 could not be found. Aug 03 19:06:46.584476 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:06:46.585910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Returning 404 to user: Instance f7e484cc-859c-4404-b392-b50dcc4cfc66 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:06:46.585910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-552f81fb-d092-4c90-b368-f9d1d20358a4 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66" status: 404 len: 111 microversion: 2.1 time: 0.030161 Aug 03 19:06:46.585910 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 548/1083] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:06:46 2022] GET /compute/v2.1/servers/f7e484cc-859c-4404-b392-b50dcc4cfc66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:06:46.751311 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2c973ca5-5d22-4ea1-b344-49df92bdf4c0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] Calling method '.version_select at 0x7fdac9d3e160>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:06:46.771333 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2c973ca5-5d22-4ea1-b344-49df92bdf4c0 tempest-TestShelveInstance-1328465601 tempest-TestShelveInstance-1328465601-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1199495827" status: 202 len: 0 microversion: 2.1 time: 0.024223 Aug 03 19:06:46.771919 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 536/1084] 10.222.0.69 () {58 vars in 1254 bytes} [Wed Aug 3 19:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1199495827 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:07:10.412499 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:07:10.413257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Wed Aug 3 19:07:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:07:12.564902 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:12.565529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:12.567943 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=8 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:12.568658 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=12 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:12.574116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:12.574574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:12.575353 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:12.575843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:12.602317 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:07:12.680903 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c4c31c6d-16c0-48ba-b2fa-05245ec1fbf8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 204 len: 0 microversion: 2.1 time: 0.119489 Aug 03 19:07:12.681507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 549/1085] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:07:12 2022] DELETE /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:07:12.687873 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:12.688673 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:12.693184 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:12.693833 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:12.703262 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:12.703720 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:12.704535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:12.704978 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:12.841161 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:12.848716 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0a3d9c1e-fd8c-4d49-aed8-d0d54b5751f6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1576 microversion: 2.1 time: 0.162212 Aug 03 19:07:12.849289 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 537/1086] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:12 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:13.871128 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:13.871827 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:13.878494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:13.878946 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:13.879709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:13.880148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:14.012693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:14.020303 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-920949de-eca0-4fe7-8b2b-99cebf0f1a5d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1576 microversion: 2.1 time: 0.153984 Aug 03 19:07:14.020862 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 550/1087] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:13 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:15.042747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:15.043696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:15.050111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:15.050563 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:15.051325 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:15.051758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:15.206566 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:15.216198 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-423cd9ca-6dc2-49fe-b74c-ec0fc28e221d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1576 microversion: 2.1 time: 0.178220 Aug 03 19:07:15.217052 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 538/1088] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:15 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:15.611935 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-9117e65f-373a-4307-aee7-b076a69e3dc5 req-30322477-bdf3-409c-82f4-fe68362e60ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2808354-602d-46bd-8f4b-1106aee02ad8", "name": "network-vif-deleted", "tag": "10e76aa3-1ea7-496e-8864-fde1a041163d"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:15.624207 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9117e65f-373a-4307-aee7-b076a69e3dc5 req-30322477-bdf3-409c-82f4-fe68362e60ae service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:15.624684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-9117e65f-373a-4307-aee7-b076a69e3dc5 req-30322477-bdf3-409c-82f4-fe68362e60ae service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:15.637250 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-9117e65f-373a-4307-aee7-b076a69e3dc5 req-30322477-bdf3-409c-82f4-fe68362e60ae service nova] Creating event network-vif-deleted:10e76aa3-1ea7-496e-8864-fde1a041163d for instance b2808354-602d-46bd-8f4b-1106aee02ad8 on hv-cinder-85164 Aug 03 19:07:15.642533 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-9117e65f-373a-4307-aee7-b076a69e3dc5 req-30322477-bdf3-409c-82f4-fe68362e60ae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034297 Aug 03 19:07:15.643221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 551/1089] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:16.237877 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:16.238532 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:16.245416 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:16.246143 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:16.246806 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:16.247256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:16.281819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:16.282282 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:16.282747 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lazy-loading 'fault' on Instance uuid b2808354-602d-46bd-8f4b-1106aee02ad8 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:07:16.327796 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:16.345139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c1bd7f0c-9946-4033-ad1a-0c722f5f6656 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 200 len: 1229 microversion: 2.1 time: 0.111304 Aug 03 19:07:16.345926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 539/1090] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:16 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 1229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:17.369643 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:17.370404 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:17.378437 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:17.378897 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:17.379677 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:17.380120 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:17.393502 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] HTTP exception thrown: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Request method failure captured: Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 HTTP/1.1 Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6safPhpzqpT1Mhx9TYZkEsnEhu_y_ckw1hiX0KC5jsbqeqqokO5S5F66ugDhIR8kE4LhPJUro-K6aVQdu1lnpZ9R4X-IRthRA5V6Jw8AocZ3SAJHiKO8tfASB8DZ2ZDVX_BFi1WNHR9kZGH5_pMUPhfVaK9ATuUjtEuLNfHhi1Qf6o0 Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:07:17.395150 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-TestVolumeBootPattern-444889007 Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 4f7e62d82d054b98bd22dc6958577a74 Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:07:17.396909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'b2808354-602d-46bd-8f4b-1106aee02ad8'} Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:07:17.397809 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:07:17.399151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:07:17.400721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Returning 404 to user: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:07:17.400721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5e8e5451-63f9-4f05-ae61-5c0ae8870d5e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 404 len: 111 microversion: 2.1 time: 0.031906 Aug 03 19:07:17.400721 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 552/1091] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:17 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:07:17.494104 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-874305509", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-631434978", "security_groups": [{"name": "tempest-secgroup-smoke-833790757"}], "block_device_mapping_v2": [{"uuid": "f155b0d1-99be-4970-9e13-fcd73ba7f780", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dd4230a-823c-4cad-a550-19090f3c110c"}]}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:17.609547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] validate_networks() for [('4dd4230a-823c-4cad-a550-19090f3c110c', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:07:17.997089 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:07:17.997521 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:07:17.998270 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:07:17.998692 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:07:17.999110 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:07:18.007998 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:18.008496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:18.009309 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:18.010637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:18.028741 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:18.032787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for user 4f7e62d82d054b98bd22dc6958577a74 and project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:18.095758 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:07:18.097893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f155b0d1-99be-4970-9e13-fcd73ba7f780',volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:07:18.230301 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-721e3c12-6f8a-443c-8ddd-e094a2846a83 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.740006 Aug 03 19:07:18.231090 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 540/1092] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:07:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:07:18.241842 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-90aabdd5-31be-45f9-8fb5-2c5af534ffad tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:18.242541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-90aabdd5-31be-45f9-8fb5-2c5af534ffad tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:18.301682 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-90aabdd5-31be-45f9-8fb5-2c5af534ffad tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:18.309841 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-90aabdd5-31be-45f9-8fb5-2c5af534ffad tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1093 microversion: 2.1 time: 0.071878 Aug 03 19:07:18.310419 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 553/1093] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:18 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:19.333547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:19.334249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:19.342356 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:19.342814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:19.343598 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:19.344041 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:19.411154 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:19.419116 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9526a7fd-48d2-4021-ab1b-d34665be9d0f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1199 microversion: 2.1 time: 0.092820 Aug 03 19:07:19.419696 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 541/1094] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:19 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:20.440530 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:20.441151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:20.452132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:20.452756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:20.453530 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:20.453964 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:20.590245 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:20.601207 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-c46ae8a8-39df-4c00-be8a-f9d2c73ca77d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.164421 Aug 03 19:07:20.602053 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 554/1095] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:20 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:20.751814 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-8dc0f386-a2fd-4397-8917-5a94d81c2671 req-74afb4be-98a2-40f1-9915-b467f01864f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b918f50e-0448-47fd-a9f8-6008adb199dc", "tag": "2162daa0-4dcf-43ce-ab7b-8f57a96c54bb"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:20.763419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8dc0f386-a2fd-4397-8917-5a94d81c2671 req-74afb4be-98a2-40f1-9915-b467f01864f6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:20.764030 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-8dc0f386-a2fd-4397-8917-5a94d81c2671 req-74afb4be-98a2-40f1-9915-b467f01864f6 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:20.775818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-8dc0f386-a2fd-4397-8917-5a94d81c2671 req-74afb4be-98a2-40f1-9915-b467f01864f6 service nova] Creating event network-changed:2162daa0-4dcf-43ce-ab7b-8f57a96c54bb for instance b918f50e-0448-47fd-a9f8-6008adb199dc on hv-cinder-85164 Aug 03 19:07:20.781300 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-8dc0f386-a2fd-4397-8917-5a94d81c2671 req-74afb4be-98a2-40f1-9915-b467f01864f6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033130 Aug 03 19:07:20.781914 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 542/1096] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:21.623378 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:21.623965 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:21.630494 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:21.630977 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:21.631735 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:21.632166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:21.769354 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:21.776795 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-96460df5-d100-4dc8-98bf-74c015b192ae tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.157985 Aug 03 19:07:21.777357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 555/1097] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:21 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:22.798519 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:22.799214 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:22.805401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:22.805879 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:22.806634 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:22.807076 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:22.939506 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:22.946985 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1194d7fe-0a7b-4418-9d2d-a88bd8dab0c6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.153072 Aug 03 19:07:22.947535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 543/1098] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:22 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:23.969254 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:23.969876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:23.976031 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:23.976529 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:23.977295 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:23.977737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:24.109351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:24.116773 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4008c7fa-d20f-4f13-8a28-7691e059358e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.151721 Aug 03 19:07:24.117358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 556/1099] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:23 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:25.138163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:25.138743 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:25.145339 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:25.145790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:25.146554 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:25.146990 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:25.280447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:25.288086 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-c1ead3e4-ed6e-4ef9-8600-0e616cbc76e1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.154788 Aug 03 19:07:25.288682 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 544/1100] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:25 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:26.308936 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:26.309633 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:26.316589 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:26.317036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:26.317794 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:26.318228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:26.453567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:26.461074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-df12e34f-b6fc-4ade-9eed-89a7a7f5fc36 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.156389 Aug 03 19:07:26.461639 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 557/1101] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:26 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:27.483117 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:27.483734 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:27.489793 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:27.490249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:27.491021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:27.491462 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:27.629835 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:27.638800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-58380a4b-b207-46ac-821b-a470365095b8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.160621 Aug 03 19:07:27.639368 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 545/1102] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:27 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:27.893771 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9eaec0a2-47a8-4519-9f56-e8cd163f2405 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:27.894300 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9eaec0a2-47a8-4519-9f56-e8cd163f2405 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:27.900381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9eaec0a2-47a8-4519-9f56-e8cd163f2405 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:27.900985 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9eaec0a2-47a8-4519-9f56-e8cd163f2405 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:27.901969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9eaec0a2-47a8-4519-9f56-e8cd163f2405 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:27.902411 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9eaec0a2-47a8-4519-9f56-e8cd163f2405 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:27.926011 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9eaec0a2-47a8-4519-9f56-e8cd163f2405 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/ips" status: 200 len: 149 microversion: 2.1 time: 0.199539 Aug 03 19:07:27.926565 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 558/1103] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 19:07:27 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/ips => generated 149 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:28.659118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:28.659727 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:28.661729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:28.662520 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:28.669168 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:28.669706 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:28.670587 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:28.671221 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:28.806281 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:28.813765 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b5ddf2df-1901-43a3-836d-d92a3a32fcd4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.158534 Aug 03 19:07:28.814336 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 546/1104] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:28 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:29.268956 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ddd6cf42-92d6-4f35-81aa-c86739b11c81 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dea406e2-8e76-4225-b57b-224b5de105d3"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:29.271384 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ddd6cf42-92d6-4f35-81aa-c86739b11c81 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:29.273388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:29.279472 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddd6cf42-92d6-4f35-81aa-c86739b11c81 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.279925 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddd6cf42-92d6-4f35-81aa-c86739b11c81 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.280730 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddd6cf42-92d6-4f35-81aa-c86739b11c81 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.281172 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ddd6cf42-92d6-4f35-81aa-c86739b11c81 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.537291 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ddd6cf42-92d6-4f35-81aa-c86739b11c81 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272068 Aug 03 19:07:29.538066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 559/1105] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 19:07:29 2022] POST /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:29.834810 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:29.835385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:29.842040 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.842485 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.843249 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:29.843685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:29.983353 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:29.990791 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1e19cf88-1e5a-4140-bc79-042be7bfc5c8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.160018 Aug 03 19:07:29.991355 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 547/1106] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:29 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:31.014051 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:31.014738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:31.020937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:31.021379 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:31.022129 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:31.022558 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:31.165629 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:31.173433 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-049fd921-54f3-466e-b94e-7fb4649e3eea tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.165038 Aug 03 19:07:31.174001 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 560/1107] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:31 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:32.194301 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:32.195955 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:32.204419 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:32.205077 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:32.205948 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:32.206550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:32.350968 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:32.358976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8a9cd3b2-d67c-4791-8bc5-62083e833ae6 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.168622 Aug 03 19:07:32.359549 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 548/1108] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:32 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:32.395802 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-c2bf3c36-e442-4b09-8909-76216e5a5210 req-a84a0756-2e79-49e0-b564-ca06ccfff2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b918f50e-0448-47fd-a9f8-6008adb199dc", "name": "network-vif-plugged", "status": "completed", "tag": "2162daa0-4dcf-43ce-ab7b-8f57a96c54bb"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:32.405979 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-c2bf3c36-e442-4b09-8909-76216e5a5210 req-a84a0756-2e79-49e0-b564-ca06ccfff2e9 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:32.406422 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-c2bf3c36-e442-4b09-8909-76216e5a5210 req-a84a0756-2e79-49e0-b564-ca06ccfff2e9 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:32.419511 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-c2bf3c36-e442-4b09-8909-76216e5a5210 req-a84a0756-2e79-49e0-b564-ca06ccfff2e9 service nova] Creating event network-vif-plugged:2162daa0-4dcf-43ce-ab7b-8f57a96c54bb for instance b918f50e-0448-47fd-a9f8-6008adb199dc on hv-cinder-85164 Aug 03 19:07:32.424412 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-c2bf3c36-e442-4b09-8909-76216e5a5210 req-a84a0756-2e79-49e0-b564-ca06ccfff2e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117008 Aug 03 19:07:32.425172 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 561/1109] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:07:33.379686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:33.380337 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:33.388463 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:33.388912 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:33.389687 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:33.390116 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:33.541518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:33.549192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-498a1e51-bc8b-479f-b95b-579a48a73092 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1264 microversion: 2.1 time: 0.173376 Aug 03 19:07:33.549775 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 549/1110] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:33 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:34.575506 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:34.576308 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:34.583126 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.583574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.584372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.584810 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.723618 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:34.731569 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b5f1dae3-e8a2-49b6-9848-3d046620e010 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1452 microversion: 2.1 time: 0.161270 Aug 03 19:07:34.732166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 562/1111] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:34 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:34.751064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:34.751685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:34.758149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.758633 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.759367 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:34.760652 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:34.897832 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:34.905383 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bc884aa3-3352-4cd4-93f9-bfdcfd7df16f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1452 microversion: 2.1 time: 0.158152 Aug 03 19:07:34.905946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 550/1112] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:34 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:36.848803 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-1fdb37ae-5554-46d7-b97a-d894033d98ba req-e59345aa-1e4e-48a2-bf19-03fb170bc7fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b918f50e-0448-47fd-a9f8-6008adb199dc", "tag": "2162daa0-4dcf-43ce-ab7b-8f57a96c54bb"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:36.859868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-1fdb37ae-5554-46d7-b97a-d894033d98ba req-e59345aa-1e4e-48a2-bf19-03fb170bc7fc service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:36.860463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-1fdb37ae-5554-46d7-b97a-d894033d98ba req-e59345aa-1e4e-48a2-bf19-03fb170bc7fc service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:36.872070 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-1fdb37ae-5554-46d7-b97a-d894033d98ba req-e59345aa-1e4e-48a2-bf19-03fb170bc7fc service nova] Creating event network-changed:2162daa0-4dcf-43ce-ab7b-8f57a96c54bb for instance b918f50e-0448-47fd-a9f8-6008adb199dc on hv-cinder-85164 Aug 03 19:07:36.877141 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-1fdb37ae-5554-46d7-b97a-d894033d98ba req-e59345aa-1e4e-48a2-bf19-03fb170bc7fc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032141 Aug 03 19:07:36.877945 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 563/1113] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:37.087921 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dea406e2-8e76-4225-b57b-224b5de105d3"}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:37.091011 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:37.097458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.097906 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.098675 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.099110 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.185976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Invalid volume: volume dea406e2-8e76-4225-b57b-224b5de105d3 is already attached to instances: 06b5663e-9397-401d-ae02-702f90396e9d Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: POST /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments HTTP/1.1 Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 74 Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:07:37.187729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {"volumeAttachment": {"volumeId": "dea406e2-8e76-4225-b57b-224b5de105d3"}} Aug 03 19:07:37.189256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Invalid volume: volume dea406e2-8e76-4225-b57b-224b5de105d3 is already attached to instances: 06b5663e-9397-401d-ae02-702f90396e9d Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'server_id': '06b5663e-9397-401d-ae02-702f90396e9d', 'body': {'volumeAttachment': {'volumeId': 'dea406e2-8e76-4225-b57b-224b5de105d3'}}} Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dea406e2-8e76-4225-b57b-224b5de105d3 is already attached to instances: 06b5663e-9397-401d-ae02-702f90396e9d Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:37.190062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dea406e2-8e76-4225-b57b-224b5de105d3 is already attached to instances: 06b5663e-9397-401d-ae02-702f90396e9d Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:37.191441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:37.192779 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:37.192779 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:07:37.192779 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:07:37.192779 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dea406e2-8e76-4225-b57b-224b5de105d3 is already attached to instances: 06b5663e-9397-401d-ae02-702f90396e9d Aug 03 19:07:37.192779 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:37.194058 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 400 to user: Invalid volume: volume dea406e2-8e76-4225-b57b-224b5de105d3 is already attached to instances: 06b5663e-9397-401d-ae02-702f90396e9d {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:07:37.194927 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-8e308739-5560-4783-b54f-6477ba0dec1d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111370 Aug 03 19:07:37.195514 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 551/1114] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 19:07:37 2022] POST /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 19:07:37.266210 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:37.266797 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:37.273121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.273567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.274332 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.274958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.362606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lazy-loading 'services' on Instance uuid 06b5663e-9397-401d-ae02-702f90396e9d {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:07:37.444693 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5820680b-d506-4647-91f3-eb26c88f7219 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments/dea406e2-8e76-4225-b57b-224b5de105d3" status: 202 len: 0 microversion: 2.1 time: 0.184606 Aug 03 19:07:37.445355 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 564/1115] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 19:07:37 2022] DELETE /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments/dea406e2-8e76-4225-b57b-224b5de105d3 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:07:37.454371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-12109b8a-4a0b-4eee-b155-c9d2cbb0d339 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:37.456744 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-12109b8a-4a0b-4eee-b155-c9d2cbb0d339 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:37.470034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12109b8a-4a0b-4eee-b155-c9d2cbb0d339 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.470601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12109b8a-4a0b-4eee-b155-c9d2cbb0d339 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.471585 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12109b8a-4a0b-4eee-b155-c9d2cbb0d339 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:37.472208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-12109b8a-4a0b-4eee-b155-c9d2cbb0d339 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:37.507138 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-12109b8a-4a0b-4eee-b155-c9d2cbb0d339 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056738 Aug 03 19:07:37.508010 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 552/1116] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:07:37 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:38.520420 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-6ed77e87-9232-4c6c-b838-4240d0a820df tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:38.522651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-6ed77e87-9232-4c6c-b838-4240d0a820df tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:38.529139 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6ed77e87-9232-4c6c-b838-4240d0a820df tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.529588 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6ed77e87-9232-4c6c-b838-4240d0a820df tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.530349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6ed77e87-9232-4c6c-b838-4240d0a820df tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.530785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-6ed77e87-9232-4c6c-b838-4240d0a820df tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.555720 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:38.561434 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-6ed77e87-9232-4c6c-b838-4240d0a820df tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045854 Aug 03 19:07:38.561937 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 565/1117] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:07:38 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:07:38.623340 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:38.623902 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:38.630247 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.630688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.631476 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.631905 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.659348 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:07:38.686861 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=100 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:38.737983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-54f57646-26e5-47f5-a9fe-4574123a81bf tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 204 len: 0 microversion: 2.1 time: 0.119117 Aug 03 19:07:38.738563 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 553/1118] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:07:38 2022] DELETE /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:07:38.747909 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:38.748563 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:38.755028 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.755477 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.756241 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:38.756727 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:38.889821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:38.897362 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-bf40778f-678a-483f-afa1-0fb329a54e82 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1680 microversion: 2.1 time: 0.154451 Aug 03 19:07:38.897930 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 566/1119] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:38 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:39.920663 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:39.921372 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:39.928184 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:39.928673 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:39.929481 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:39.929922 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:40.065303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:40.073788 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-2b136bd9-bf1d-4fcd-85d9-4063ce13b164 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1680 microversion: 2.1 time: 0.157950 Aug 03 19:07:40.074369 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 554/1120] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:39 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:41.094716 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:41.095315 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:41.101876 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:41.102325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:41.103078 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:41.103511 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:41.293874 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:41.300995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2cb66dd6-95fc-4a83-87ae-a25788f2fc2d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1680 microversion: 2.1 time: 0.210077 Aug 03 19:07:41.301734 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 567/1121] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:41 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:07:42.015349 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-ea76c3e5-92b6-4125-9918-886480861927 req-47b5af08-1a2c-46bd-850c-47e4081ff0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b5663e-9397-401d-ae02-702f90396e9d", "name": "network-vif-deleted", "tag": "8736ad67-a248-4dd5-b91e-6b34f182bd1e"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:42.026853 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-ea76c3e5-92b6-4125-9918-886480861927 req-47b5af08-1a2c-46bd-850c-47e4081ff0e1 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.027394 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-ea76c3e5-92b6-4125-9918-886480861927 req-47b5af08-1a2c-46bd-850c-47e4081ff0e1 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.039234 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-ea76c3e5-92b6-4125-9918-886480861927 req-47b5af08-1a2c-46bd-850c-47e4081ff0e1 service nova] Creating event network-vif-deleted:8736ad67-a248-4dd5-b91e-6b34f182bd1e for instance 06b5663e-9397-401d-ae02-702f90396e9d on hv-cinder-85164 Aug 03 19:07:42.045621 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-ea76c3e5-92b6-4125-9918-886480861927 req-47b5af08-1a2c-46bd-850c-47e4081ff0e1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Aug 03 19:07:42.046858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 555/1122] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:42.323309 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:42.324066 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:42.331089 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.331540 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.332557 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.332999 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.377862 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:42.378589 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:42.379302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.objects.instance [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lazy-loading 'fault' on Instance uuid 06b5663e-9397-401d-ae02-702f90396e9d {{(pid=129369) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:07:42.429792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:42.440232 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-03c84655-7bcb-4446-923e-17113c72b785 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 200 len: 1331 microversion: 2.1 time: 0.120875 Aug 03 19:07:42.440867 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 568/1123] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:42 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:43.462338 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:43.464082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:43.466161 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:43.471511 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:43.471959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:43.472752 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:43.473208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:43.491733 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d HTTP/1.1 Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:07:43.493408 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:07:43.495341 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '06b5663e-9397-401d-ae02-702f90396e9d'} Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:07:43.496455 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:07:43.498212 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:07:43.499753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:07:43.499753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b18ec2d3-00ee-46d3-9a53-1598d127cfba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 404 len: 111 microversion: 2.1 time: 0.037259 Aug 03 19:07:43.499753 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 556/1124] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:43 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:07:43.504072 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5c447265-6e9b-4dad-984a-d723af92b564 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '.version_select at 0x7fdac9d4bdc0>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:43.512835 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:43.529867 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5c447265-6e9b-4dad-984a-d723af92b564 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-148847847" status: 202 len: 0 microversion: 2.1 time: 0.029414 Aug 03 19:07:43.530473 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 569/1125] 10.222.0.69 () {58 vars in 1218 bytes} [Wed Aug 3 19:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-148847847 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:07:44.152869 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dfbe3ebb-ee3b-4af0-9b67-3afb9d424aca tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: .version_select at 0x7fdac9f57700>, body: {"keypair": {"name": "tempest-keypair-794644947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmZkBQlXydwMuE6Z6TaUvHTYtpQorys400xtJafP+NyHa0hWDNhY/p0ixeCGq02ZKtLpdeGKvXoGijT0U35YvxbLnZMNR4i0/4+rTnk9qmZqt3pWytXWR4tkGJpa2g9mQ=="}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:44.168861 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-dfbe3ebb-ee3b-4af0-9b67-3afb9d424aca tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:44.172623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-dfbe3ebb-ee3b-4af0-9b67-3afb9d424aca tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'key_pairs'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:44.194538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-dfbe3ebb-ee3b-4af0-9b67-3afb9d424aca tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046141 Aug 03 19:07:44.195107 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 557/1126] 10.222.0.69 () {60 vars in 1159 bytes} [Wed Aug 3 19:07:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:45.651187 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1909369109", "imageRef": "8d683a81-269c-4873-a3eb-724fe2a8e6df", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b7445c4-4df7-4e9a-ab26-f2a5eef98b34"}], "security_groups": [{"name": "tempest-securitygroup--317140905"}], "key_name": "tempest-keypair-794644947", "user_data": "}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:45.754263 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.network.neutron [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] validate_networks() for [('9b7445c4-4df7-4e9a-ab26-f2a5eef98b34', None, None, None, None, None)] {{(pid=129369) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:07:46.120983 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:07:46.121406 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image limits 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:07:46.121904 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Flavor pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:07:46.122369 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Image pref 0:0:0 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:07:46.122779 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.virt.hardware [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129369) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:07:46.131520 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:46.131964 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:46.132782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:46.133215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:46.150727 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:07:46.154651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.quota [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Getting quotas for user cd2bc7050bb9413c8fddd9c7864f537a and project 6a6eee7038a04ad988d383473d0113a4. Resources: {'ram', 'instances', 'cores'} {{(pid=129369) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:07:46.165401 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Going to run 1 instances... {{(pid=129369) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:07:46.167887 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d683a81-269c-4873-a3eb-724fe2a8e6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129369) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:07:46.216223 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-75468171-89fa-467f-a28a-53e42e122484 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.569866 Aug 03 19:07:46.216912 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 570/1127] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:07:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 19:07:46.228746 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b4cb78c0-6ffc-4205-b08e-e6e1ae13b8ce tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:46.229407 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b4cb78c0-6ffc-4205-b08e-e6e1ae13b8ce tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:46.286612 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b4cb78c0-6ffc-4205-b08e-e6e1ae13b8ce tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:46.294519 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b4cb78c0-6ffc-4205-b08e-e6e1ae13b8ce tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1241 microversion: 2.1 time: 0.070649 Aug 03 19:07:46.295465 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 558/1128] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:46 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:47.317146 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:47.317774 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:47.326862 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:47.327611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:47.328516 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:47.329123 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:47.403061 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:47.410661 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-466186fa-b494-4046-8e0d-5b7d7f6bc64b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1311 microversion: 2.1 time: 0.098423 Aug 03 19:07:47.411257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 571/1129] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:47 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:48.433106 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:48.433896 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:48.440487 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.440938 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.441712 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.442157 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.661522 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:48.669671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b50b2913-711f-4405-b29f-3eda5c3a7ed3 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1366 microversion: 2.1 time: 0.241010 Aug 03 19:07:48.670266 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 559/1130] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:48 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:48.783974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-2399b907-1dcb-46f0-a28d-93428916204d req-6e257ba6-3eed-48c3-9888-86e14c0aaf84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbe5d64-5efe-4788-b0e8-ce06d67734b4", "tag": "eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:48.795708 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-2399b907-1dcb-46f0-a28d-93428916204d req-6e257ba6-3eed-48c3-9888-86e14c0aaf84 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:48.796161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-2399b907-1dcb-46f0-a28d-93428916204d req-6e257ba6-3eed-48c3-9888-86e14c0aaf84 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:48.809457 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-2399b907-1dcb-46f0-a28d-93428916204d req-6e257ba6-3eed-48c3-9888-86e14c0aaf84 service nova] Creating event network-changed:eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3 for instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 on hv-cinder-85164 Aug 03 19:07:48.814164 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-2399b907-1dcb-46f0-a28d-93428916204d req-6e257ba6-3eed-48c3-9888-86e14c0aaf84 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033923 Aug 03 19:07:48.821155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 572/1131] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:49.692238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:49.692884 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:49.700180 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:49.700670 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:49.701440 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:49.701882 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:49.833072 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:49.841621 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-5c2e260d-183f-4ef1-8992-02b6e5d52af9 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1366 microversion: 2.1 time: 0.153326 Aug 03 19:07:49.842195 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 560/1132] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:49 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:50.863286 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:50.863987 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:50.870846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:50.871202 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:50.871998 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:50.872472 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:51.015132 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:51.023459 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-30de8273-563d-4aca-bbb4-f2163a6f8587 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1366 microversion: 2.1 time: 0.164302 Aug 03 19:07:51.024032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 573/1133] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:50 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:52.046062 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:52.046685 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:52.053173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:52.053623 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:52.054386 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:52.054824 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:52.459377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:52.467359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e1067d2f-8615-41fd-b39f-e40f55029346 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1366 microversion: 2.1 time: 0.425975 Aug 03 19:07:52.468345 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 561/1134] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:52 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:53.490353 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:53.490970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:53.498225 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:53.498659 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:53.499420 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:53.499851 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:53.628976 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:53.637097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-32802730-77c5-4700-93b0-09e40aa0cca4 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1366 microversion: 2.1 time: 0.150547 Aug 03 19:07:53.637897 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 574/1135] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:53 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:54.457343 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-0ea3aa79-795d-4ee7-b072-d3357a5250f0 req-f893b06c-8424-4df9-bbab-0c778aa55615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbe5d64-5efe-4788-b0e8-ce06d67734b4", "name": "network-vif-plugged", "status": "completed", "tag": "eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:54.468933 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-0ea3aa79-795d-4ee7-b072-d3357a5250f0 req-f893b06c-8424-4df9-bbab-0c778aa55615 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:54.469352 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-0ea3aa79-795d-4ee7-b072-d3357a5250f0 req-f893b06c-8424-4df9-bbab-0c778aa55615 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:54.481509 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-0ea3aa79-795d-4ee7-b072-d3357a5250f0 req-f893b06c-8424-4df9-bbab-0c778aa55615 service nova] Creating event network-vif-plugged:eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3 for instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 on hv-cinder-85164 Aug 03 19:07:54.486573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-0ea3aa79-795d-4ee7-b072-d3357a5250f0 req-f893b06c-8424-4df9-bbab-0c778aa55615 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033097 Aug 03 19:07:54.487169 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 562/1136] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:54.657821 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:54.658388 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:54.665321 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:54.665782 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:54.667119 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:54.667662 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:54.830686 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:54.838123 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-7e9f6b57-fb78-4e04-a912-a2fe748e1856 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1366 microversion: 2.1 time: 0.184226 Aug 03 19:07:54.838691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 575/1137] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:54 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:55.860140 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:55.860790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:55.867016 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:55.867466 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:55.868222 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:55.868682 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:56.001619 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:56.009036 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e7d6473a-1845-4abd-869c-2d4c2ba38ada tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1366 microversion: 2.1 time: 0.153640 Aug 03 19:07:56.009667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 563/1138] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:55 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:57.031019 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:57.031627 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:57.034141 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:57.034785 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:57.041667 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.042125 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.042899 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.043339 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.174205 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:07:57.182271 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8392ee3a-14dc-4308-b259-fbf508639acc tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1555 microversion: 2.1 time: 0.154580 Aug 03 19:07:57.182851 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 576/1139] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:07:57 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:07:57.202068 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-d9ff678b-4bf7-45d6-bb5a-b4cf727f7e23 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:07:57.202588 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-d9ff678b-4bf7-45d6-bb5a-b4cf727f7e23 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:07:57.204553 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=6 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:07:57.210411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ff678b-4bf7-45d6-bb5a-b4cf727f7e23 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.210863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ff678b-4bf7-45d6-bb5a-b4cf727f7e23 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.211632 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ff678b-4bf7-45d6-bb5a-b4cf727f7e23 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:57.212074 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-d9ff678b-4bf7-45d6-bb5a-b4cf727f7e23 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:57.288704 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-d9ff678b-4bf7-45d6-bb5a-b4cf727f7e23 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090498 Aug 03 19:07:57.289306 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 564/1140] 10.222.0.69 () {58 vars in 1275 bytes} [Wed Aug 3 19:07:57 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:07:58.241815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-adc29ba1-5a3e-4345-aa8c-bc12eb8d5c5c req-b1ae1212-b454-4b17-8794-da8a2032df13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dbe5d64-5efe-4788-b0e8-ce06d67734b4", "tag": "eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:07:58.251931 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-adc29ba1-5a3e-4345-aa8c-bc12eb8d5c5c req-b1ae1212-b454-4b17-8794-da8a2032df13 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:07:58.252391 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-adc29ba1-5a3e-4345-aa8c-bc12eb8d5c5c req-b1ae1212-b454-4b17-8794-da8a2032df13 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:07:58.263456 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-adc29ba1-5a3e-4345-aa8c-bc12eb8d5c5c req-b1ae1212-b454-4b17-8794-da8a2032df13 service nova] Creating event network-changed:eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3 for instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 on hv-cinder-85164 Aug 03 19:07:58.268581 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-adc29ba1-5a3e-4345-aa8c-bc12eb8d5c5c req-b1ae1212-b454-4b17-8794-da8a2032df13 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030673 Aug 03 19:07:58.269195 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 577/1141] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:13.258545 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:13.259310 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:13.263890 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0a1ea4a7-c5e0-4b42-b713-907f2c52f616 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:13.264421 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-0a1ea4a7-c5e0-4b42-b713-907f2c52f616 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:13.272911 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a1ea4a7-c5e0-4b42-b713-907f2c52f616 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:13.273361 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a1ea4a7-c5e0-4b42-b713-907f2c52f616 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:13.274653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a1ea4a7-c5e0-4b42-b713-907f2c52f616 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:13.275082 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-0a1ea4a7-c5e0-4b42-b713-907f2c52f616 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:13.299538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0a1ea4a7-c5e0-4b42-b713-907f2c52f616 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/ips" status: 200 len: 149 microversion: 2.1 time: 0.043001 Aug 03 19:09:13.300101 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 565/1142] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 19:09:13 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:14.643487 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:14.644221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=56 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:14.649349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9cca45dc-e0cf-4fdd-ab70-60aaa82640db tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58e84e25-727e-46dd-b478-cc869749c3a5"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:09:14.651846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-9cca45dc-e0cf-4fdd-ab70-60aaa82640db tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:14.659888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cca45dc-e0cf-4fdd-ab70-60aaa82640db tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:14.660366 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cca45dc-e0cf-4fdd-ab70-60aaa82640db tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:14.661130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cca45dc-e0cf-4fdd-ab70-60aaa82640db tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:14.661566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-9cca45dc-e0cf-4fdd-ab70-60aaa82640db tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:14.932923 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9cca45dc-e0cf-4fdd-ab70-60aaa82640db tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "POST /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291305 Aug 03 19:09:14.933541 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 578/1143] 10.222.0.69 () {60 vars in 1323 bytes} [Wed Aug 3 19:09:14 2022] POST /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:22.559787 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:22.560371 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:22.566327 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:22.566778 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:22.567541 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:22.567979 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:22.651136 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lazy-loading 'services' on Instance uuid 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:09:22.724788 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9509b9f4-488c-4828-9a7d-a388bcf64411 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments/58e84e25-727e-46dd-b478-cc869749c3a5" status: 202 len: 0 microversion: 2.1 time: 0.169705 Aug 03 19:09:22.725368 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 566/1144] 10.222.0.69 () {58 vars in 1416 bytes} [Wed Aug 3 19:09:22 2022] DELETE /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments/58e84e25-727e-46dd-b478-cc869749c3a5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:09:22.735297 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-826aeae0-acc0-4bbf-85ca-e4f327d8ef0c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:22.737680 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-826aeae0-acc0-4bbf-85ca-e4f327d8ef0c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:22.745153 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-826aeae0-acc0-4bbf-85ca-e4f327d8ef0c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:22.745505 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-826aeae0-acc0-4bbf-85ca-e4f327d8ef0c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:22.746257 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-826aeae0-acc0-4bbf-85ca-e4f327d8ef0c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:22.746636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-826aeae0-acc0-4bbf-85ca-e4f327d8ef0c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:22.778398 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-826aeae0-acc0-4bbf-85ca-e4f327d8ef0c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047927 Aug 03 19:09:22.778961 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 579/1145] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:09:22 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:23.792666 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-629d1201-e375-43f0-be6b-37b21a1990f1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:23.795646 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-629d1201-e375-43f0-be6b-37b21a1990f1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:23.802043 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-629d1201-e375-43f0-be6b-37b21a1990f1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:23.802493 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-629d1201-e375-43f0-be6b-37b21a1990f1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:23.803280 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-629d1201-e375-43f0-be6b-37b21a1990f1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:23.803818 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-629d1201-e375-43f0-be6b-37b21a1990f1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:23.833073 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-629d1201-e375-43f0-be6b-37b21a1990f1 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045750 Aug 03 19:09:23.833547 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 567/1146] 10.222.0.69 () {58 vars in 1302 bytes} [Wed Aug 3 19:09:23 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 19:09:23.895651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:23.896173 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:23.903057 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:23.903508 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:23.904325 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:23.904768 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:23.930282 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:09:24.019580 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-5b15c378-b8fb-4d73-b2d4-3152705e7d93 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 204 len: 0 microversion: 2.1 time: 0.127540 Aug 03 19:09:24.020416 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 580/1147] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:09:23 2022] DELETE /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:09:24.029461 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:24.030084 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:24.036060 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:24.036552 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:24.037312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:24.037749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:24.175777 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:24.185879 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-31269e2f-c85c-4ec8-b2bb-36de1a1f5280 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1680 microversion: 2.1 time: 0.160441 Aug 03 19:09:24.186447 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 568/1148] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:24 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:09:25.207694 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:25.208440 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:25.215617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:25.216075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:25.216920 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:25.217365 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:25.347989 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:25.355595 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-eb3c8fa6-c9a6-4088-8449-8221406af069 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1680 microversion: 2.1 time: 0.152187 Aug 03 19:09:25.356171 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 581/1149] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:25 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:26.377359 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:26.378002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:26.385441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:26.386150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:26.386940 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:26.387378 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:26.582036 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:26.590269 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-213c4019-b85a-4119-bb89-1148b64e3aa7 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1680 microversion: 2.1 time: 0.216794 Aug 03 19:09:26.590845 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 569/1150] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:26 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:26.970161 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-f3cc7b5d-eb5e-4153-a1bd-6dfbd65decd1 req-6a3f7d08-725e-4adf-bef1-655fa54657c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dbe5d64-5efe-4788-b0e8-ce06d67734b4", "name": "network-vif-deleted", "tag": "eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:09:26.981148 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-f3cc7b5d-eb5e-4153-a1bd-6dfbd65decd1 req-6a3f7d08-725e-4adf-bef1-655fa54657c1 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:26.981601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-f3cc7b5d-eb5e-4153-a1bd-6dfbd65decd1 req-6a3f7d08-725e-4adf-bef1-655fa54657c1 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:26.993970 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-f3cc7b5d-eb5e-4153-a1bd-6dfbd65decd1 req-6a3f7d08-725e-4adf-bef1-655fa54657c1 service nova] Creating event network-vif-deleted:eddea0ab-cf0c-47f7-8b4d-45fdb2774ba3 for instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 on hv-cinder-85164 Aug 03 19:09:26.999557 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-f3cc7b5d-eb5e-4153-a1bd-6dfbd65decd1 req-6a3f7d08-725e-4adf-bef1-655fa54657c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032878 Aug 03 19:09:27.000239 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 582/1151] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:27.612461 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:27.613093 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:27.623535 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:27.624387 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:27.625163 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:27.625603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:27.664377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:27.665342 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:27.665786 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.objects.instance [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lazy-loading 'fault' on Instance uuid 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 {{(pid=129368) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 19:09:27.712521 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd2bc7050bb9413c8fddd9c7864f537a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6eee7038a04ad988d383473d0113a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:27.719333 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-71840349-eadd-424e-9b35-d557bb1a0cba tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 200 len: 1331 microversion: 2.1 time: 0.110768 Aug 03 19:09:27.719889 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 570/1152] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:27 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:28.742692 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:28.743470 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:28.749792 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:28.750233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:28.750985 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:28.751414 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:28.767462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 HTTP/1.1 Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:09:28.769079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:28.770824 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '6dbe5d64-5efe-4788-b0e8-ce06d67734b4'} Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:28.771974 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:28.774259 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:28.775790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:28.775790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2d9cf93b-4b2f-445d-a817-1bb735128f86 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 404 len: 111 microversion: 2.1 time: 0.032705 Aug 03 19:09:28.775790 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 583/1153] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:28 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:09:28.780279 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-724dcfcb-3c90-4fd0-9802-bb59e4f79e9d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '.version_select at 0x7fdac9de9c10>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:28.798897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-724dcfcb-3c90-4fd0-9802-bb59e4f79e9d tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794644947" status: 202 len: 0 microversion: 2.1 time: 0.022511 Aug 03 19:09:28.799449 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 571/1154] 10.222.0.69 () {58 vars in 1218 bytes} [Wed Aug 3 19:09:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794644947 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:09:30.541817 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:30.542312 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:30.548875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:30.549331 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:30.550097 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:30.550538 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:30.564501 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: DELETE /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 HTTP/1.1 Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:09:30.566145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.567833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '6dbe5d64-5efe-4788-b0e8-ce06d67734b4'} Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:30.568984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.571336 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.573057 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:30.573057 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d4b57f75-915b-4b80-9f4f-28f321a61a4c tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 404 len: 111 microversion: 2.1 time: 0.029672 Aug 03 19:09:30.573057 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 584/1155] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:09:30 2022] DELETE /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:30.576970 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:30.577597 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 6dbe5d64-5efe-4788-b0e8-ce06d67734b4] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:30.584939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:30.585396 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:30.586188 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:30.586677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:30.599442 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 HTTP/1.1 Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:09:30.601118 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.602946 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '6dbe5d64-5efe-4788-b0e8-ce06d67734b4'} Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:30.603904 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. Aug 03 19:09:30.605454 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:30.606804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 6dbe5d64-5efe-4788-b0e8-ce06d67734b4 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:30.606804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bd2938f9-988c-4a89-9394-9b5cc031a606 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4" status: 404 len: 111 microversion: 2.1 time: 0.029584 Aug 03 19:09:30.606804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 572/1156] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:30 2022] GET /compute/v2.1/servers/6dbe5d64-5efe-4788-b0e8-ce06d67734b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:31.755647 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:31.756147 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:31.762962 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.763421 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.764215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.764686 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.778079 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: DELETE /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d HTTP/1.1 Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:09:31.779636 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.781357 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '06b5663e-9397-401d-ae02-702f90396e9d'} Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:31.782426 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.783959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.785606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:31.785606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-be6a3f61-b0bd-49e1-acd0-dc1e5f55023b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 404 len: 111 microversion: 2.1 time: 0.029269 Aug 03 19:09:31.785606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 585/1157] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:09:31 2022] DELETE /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:31.790865 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:31.791483 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 06b5663e-9397-401d-ae02-702f90396e9d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:31.798021 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.798474 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.799239 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.799677 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.813253 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d HTTP/1.1 Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:09:31.814792 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.816456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '06b5663e-9397-401d-ae02-702f90396e9d'} Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:31.817586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. Aug 03 19:09:31.819193 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.820837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 06b5663e-9397-401d-ae02-702f90396e9d could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:31.820837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-dd5c185c-0cfc-403f-9962-80ffc48a1661 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d" status: 404 len: 111 microversion: 2.1 time: 0.029947 Aug 03 19:09:31.820837 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 573/1158] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:31 2022] GET /compute/v2.1/servers/06b5663e-9397-401d-ae02-702f90396e9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:31.825180 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:31.825678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:31.831639 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.832085 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.832878 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.833310 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.847768 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: DELETE /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 HTTP/1.1 Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:09:31.849349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.850995 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '74508c60-b1e4-414d-ac03-4dba643bbba7'} Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:31.852846 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.854617 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.856249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:31.856249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-657a991f-e6b7-4461-af6c-01ba8da984fd tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 404 len: 111 microversion: 2.1 time: 0.029368 Aug 03 19:09:31.856249 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 586/1159] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:09:31 2022] DELETE /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:31.861192 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:31.861819 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: 74508c60-b1e4-414d-ac03-4dba643bbba7] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:31.867920 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.868401 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.869173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:31.869658 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:31.882804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 HTTP/1.1 Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:09:31.884363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.886409 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '74508c60-b1e4-414d-ac03-4dba643bbba7'} Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:31.887538 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. Aug 03 19:09:31.889091 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:31.890573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance 74508c60-b1e4-414d-ac03-4dba643bbba7 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:31.890573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-9f4842e2-89dc-420d-b8b2-374fdbb7131b tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7" status: 404 len: 111 microversion: 2.1 time: 0.029884 Aug 03 19:09:31.890573 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 574/1160] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:31 2022] GET /compute/v2.1/servers/74508c60-b1e4-414d-ac03-4dba643bbba7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:33.024574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:33.025181 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:33.031867 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:33.032353 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:33.033131 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:33.033567 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:33.046981 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: DELETE /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d HTTP/1.1 Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:09:33.048566 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.050176 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'a1630d33-81ce-4d63-ad4e-bd5d1eb5359d'} Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:33.051274 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.052838 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.054451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:33.054451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-021649e4-7958-4b5d-a784-5da2d184f543 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 404 len: 111 microversion: 2.1 time: 0.029988 Aug 03 19:09:33.054451 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 587/1161] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:09:33 2022] DELETE /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:33.058969 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:33.059594 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] [instance: a1630d33-81ce-4d63-ad4e-bd5d1eb5359d] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:33.065548 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:33.066002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:33.066768 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:33.067210 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:33.081983 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] HTTP exception thrown: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Request method failure captured: Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d HTTP/1.1 Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sYQiSNT3jBYGKEGtaa4QkQnRkapKc96-Tg74gJqnNY-jN0-7iQAXbl_2n8oMj476yCUjS-g-1Hnv-TVGqmWUa5vqb3nfdOFtzA0lV3g6wJPbEwcO8xylj5ny6Vi3pZb1-X2Mq79kGlbgwEgib7xsKEK3YkC73NO-n6o-hz2pPr0-Cc Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:09:33.083656 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/6a6eee7038a04ad988d383473d0113a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 6a6eee7038a04ad988d383473d0113a4 Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-284486981 Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: cd2bc7050bb9413c8fddd9c7864f537a Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-AttachVolumeNegativeTest-284486981-project Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.085286 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'a1630d33-81ce-4d63-ad4e-bd5d1eb5359d'} Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:33.087202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. Aug 03 19:09:33.088997 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:33.090499 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] Returning 404 to user: Instance a1630d33-81ce-4d63-ad4e-bd5d1eb5359d could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:33.090499 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-cd592e85-9d0e-42a0-b049-ffa98ab0ced0 tempest-AttachVolumeNegativeTest-284486981 tempest-AttachVolumeNegativeTest-284486981-project] 10.222.0.69 "GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d" status: 404 len: 111 microversion: 2.1 time: 0.030810 Aug 03 19:09:33.090499 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 575/1162] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:33 2022] GET /compute/v2.1/servers/a1630d33-81ce-4d63-ad4e-bd5d1eb5359d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:37.874575 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f86a5939-0dfe-4c40-b8b5-cb8323b3fe50 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Action: 'create', calling method: .version_select at 0x7fdac9deae50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1217046368"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:09:38.171226 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f86a5939-0dfe-4c40-b8b5-cb8323b3fe50 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.446843 Aug 03 19:09:38.172122 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 588/1163] 10.222.0.69 () {60 vars in 1155 bytes} [Wed Aug 3 19:09:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 448 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 19:09:38.184073 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ab42a63c-97ef-4bbf-adcf-9cfe39219510 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9e833a0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:38.234208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ab42a63c-97ef-4bbf-adcf-9cfe39219510 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 200 len: 345 microversion: 2.1 time: 0.053880 Aug 03 19:09:38.234858 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 576/1164] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:38 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:39.248718 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-630493e5-f926-45b3-9583-f4e0ea3d9eba tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d5b280>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:39.295780 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-630493e5-f926-45b3-9583-f4e0ea3d9eba tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 200 len: 345 microversion: 2.1 time: 0.051306 Aug 03 19:09:39.296372 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 589/1165] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:39 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:40.309150 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ddb40ce6-46ff-49cc-96a2-a3380eed97a3 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9de9a60>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:40.356139 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ddb40ce6-46ff-49cc-96a2-a3380eed97a3 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 200 len: 345 microversion: 2.1 time: 0.051438 Aug 03 19:09:40.356757 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 577/1166] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:40 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:41.371175 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a2c32fe5-f6f7-407b-943a-38b405500ba6 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9deab80>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:41.419347 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a2c32fe5-f6f7-407b-943a-38b405500ba6 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 200 len: 345 microversion: 2.1 time: 0.053284 Aug 03 19:09:41.419923 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 590/1167] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:41 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:42.435149 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0872ecb5-b0bd-40a4-aced-7e3b38b6cdec tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9f1c430>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:42.481943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0872ecb5-b0bd-40a4-aced-7e3b38b6cdec tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 200 len: 346 microversion: 2.1 time: 0.052351 Aug 03 19:09:42.482543 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 578/1168] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:42 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:42.495302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9a529a9d-ee84-426f-bc14-1d682aa82f66 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Action: 'create', calling method: .version_select at 0x7fdac9dc2b80>, body: {"snapshot": {"volume_id": "47598fb5-5fbd-4622-b27c-bcdf710a1b4a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-737576471"}} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:09:42.649833 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9a529a9d-ee84-426f-bc14-1d682aa82f66 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.158963 Aug 03 19:09:42.650464 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 591/1169] 10.222.0.69 () {60 vars in 1162 bytes} [Wed Aug 3 19:09:42 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:42.661111 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b9fc814b-bf39-481d-b662-0d51f817bb9f tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9f12670>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:42.691893 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b9fc814b-bf39-481d-b662-0d51f817bb9f tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.034614 Aug 03 19:09:42.692501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 579/1170] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:42 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:42.704462 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ae3d6991-3089-4e47-8fa5-2ae815cbfa5e tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d5b670>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:42.736036 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ae3d6991-3089-4e47-8fa5-2ae815cbfa5e tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035681 Aug 03 19:09:42.736660 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 592/1171] 10.222.0.69 () {58 vars in 1140 bytes} [Wed Aug 3 19:09:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:42.748352 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1013ee71-48a4-4aa4-9296-f249fd0fc6d7 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9e24f70>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:42.777044 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1013ee71-48a4-4aa4-9296-f249fd0fc6d7 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.032647 Aug 03 19:09:42.777645 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 580/1172] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:42 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:43.786349 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:43.787170 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:43.792942 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-03cc2bf8-32f9-445b-a79a-5c09fcbdc868 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9dc2700>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:43.822672 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-03cc2bf8-32f9-445b-a79a-5c09fcbdc868 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.037060 Aug 03 19:09:43.823243 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 593/1173] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:43 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:44.831637 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:44.832425 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:09:44.837416 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1581651d-a3b0-4adf-9174-9b5f0145d98a tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d98550>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:44.867897 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1581651d-a3b0-4adf-9174-9b5f0145d98a tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.037015 Aug 03 19:09:44.868610 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 581/1174] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:44 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:45.880734 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-87793019-c87f-4afb-afaf-03db57c95fd9 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d2f5e0>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:45.909814 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-87793019-c87f-4afb-afaf-03db57c95fd9 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.033527 Aug 03 19:09:45.910375 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 594/1175] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:45 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:46.925104 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bbdd20bc-1b6f-4111-b90b-46bfd863a965 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d58dc0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:46.959570 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bbdd20bc-1b6f-4111-b90b-46bfd863a965 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.038787 Aug 03 19:09:46.960243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 582/1176] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:46 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:47.973674 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1d5580b4-e104-489b-baf5-f91c12dc3f77 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d38700>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:48.004429 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1d5580b4-e104-489b-baf5-f91c12dc3f77 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.035119 Aug 03 19:09:48.004984 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 595/1177] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:47 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:49.018472 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0fdcc8e7-c14e-4c13-90dc-12a7ae23d768 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9fc55e0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:49.048318 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0fdcc8e7-c14e-4c13-90dc-12a7ae23d768 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.034220 Aug 03 19:09:49.048877 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 583/1178] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:49 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:50.061744 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-57452f23-fdfc-44d1-9e96-e3b689aedf9f tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9deab80>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:50.091007 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-57452f23-fdfc-44d1-9e96-e3b689aedf9f tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.033592 Aug 03 19:09:50.091571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 596/1179] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:50 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:51.104863 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-09ccde1a-65a6-45fc-a8fb-7d44b6dad41f tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9f1c1f0>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:51.136398 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-09ccde1a-65a6-45fc-a8fb-7d44b6dad41f tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.036216 Aug 03 19:09:51.136961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 584/1180] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:51 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:09:52.149410 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-481a4126-cd4e-4d49-be2a-c26011b22087 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d4bdc0>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:52.177969 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-481a4126-cd4e-4d49-be2a-c26011b22087 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 287 microversion: 2.1 time: 0.032922 Aug 03 19:09:52.178538 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 597/1181] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:52 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:52.190435 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-bd5faa6f-e823-4c73-b005-09d1a4e9a187 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9fc5280>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:52.248190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-bd5faa6f-e823-4c73-b005-09d1a4e9a187 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 202 len: 0 microversion: 2.1 time: 0.061829 Aug 03 19:09:52.249120 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 585/1182] 10.222.0.69 () {58 vars in 1254 bytes} [Wed Aug 3 19:09:52 2022] DELETE /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:09:52.258607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-9f8e8d52-4cb5-44eb-9410-978f79682c79 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d5b160>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:52.289317 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-9f8e8d52-4cb5-44eb-9410-978f79682c79 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 200 len: 286 microversion: 2.1 time: 0.035277 Aug 03 19:09:52.289988 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 598/1183] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:52 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:09:52.933582 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1995706910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-631434978", "security_groups": [{"name": "tempest-secgroup-smoke-833790757"}], "block_device_mapping_v2": [{"uuid": "028bc371-199a-4cf0-b154-1cac6a82960e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dd4230a-823c-4cad-a550-19090f3c110c"}]}} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:09:53.046402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.network.neutron [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] validate_networks() for [('4dd4230a-823c-4cad-a550-19090f3c110c', None, None, None, None, None)] {{(pid=129368) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 19:09:53.302607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cbe99e3d-06c6-4955-979c-65b72017d166 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9deadc0>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:53.327507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-cbe99e3d-06c6-4955-979c-65b72017d166 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] HTTP exception thrown: Snapshot 586a599d-4956-47b5-ba03-a26350b930e0 could not be found. Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cbe99e3d-06c6-4955-979c-65b72017d166 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Request method failure captured: Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 HTTP/1.1 Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sfxuqCSYf9_M1SIhCbbvkkSUBM3q_zgSFh3GKfwzdEljO3FH5j-TpUwN-OIg9gYmS-o2zPLv6duWckPI67XheeZvZGsFUOXgpUZKr2AjC1-9gFpZ79PDFDrXJ7BrgkiSSJ0H18Y0qyaa3A8---Nx9XjSkOdwilXgDZFNmuxNBzkatQ Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:09:53.329770 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: a23b8f68e3094dac80d03274158dec15 Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Snapshot 586a599d-4956-47b5-ba03-a26350b930e0 could not be found. Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '586a599d-4956-47b5-ba03-a26350b930e0'} Aug 03 19:09:53.331584 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 586a599d-4956-47b5-ba03-a26350b930e0 could not be found. (HTTP 404) (Request-ID: req-fbd01cfb-5f50-4152-9a6b-2fbb28684289) Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:53.332571 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:09:53.333958 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 586a599d-4956-47b5-ba03-a26350b930e0 could not be found. Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 19:09:53.336783 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 586a599d-4956-47b5-ba03-a26350b930e0 could not be found. Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 586a599d-4956-47b5-ba03-a26350b930e0 could not be found. Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-cbe99e3d-06c6-4955-979c-65b72017d166 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Returning 404 to user: Snapshot 586a599d-4956-47b5-ba03-a26350b930e0 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:53.340075 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-cbe99e3d-06c6-4955-979c-65b72017d166 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0" status: 404 len: 111 microversion: 2.1 time: 0.033029 Aug 03 19:09:53.342394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 599/1184] 10.222.0.69 () {58 vars in 1251 bytes} [Wed Aug 3 19:09:53 2022] GET /compute/v2.1/os-snapshots/586a599d-4956-47b5-ba03-a26350b930e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:09:53.342394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-f1d10178-e5c1-49b3-b4be-d24a19cd8a35 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9d38820>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:53.403725 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-f1d10178-e5c1-49b3-b4be-d24a19cd8a35 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 202 len: 0 microversion: 2.1 time: 0.066541 Aug 03 19:09:53.404324 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 600/1185] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 19:09:53 2022] DELETE /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 19:09:53.412512 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-8f71cc2d-d10b-4fd9-8796-31d20cf754eb tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9dea820>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:53.464246 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-8f71cc2d-d10b-4fd9-8796-31d20cf754eb tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 200 len: 345 microversion: 2.1 time: 0.055590 Aug 03 19:09:53.464840 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 601/1186] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:53 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:09:53.539441 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Flavor limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 19:09:53.539972 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Image limits 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 19:09:53.540351 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Flavor pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 19:09:53.540841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Image pref 0:0:0 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 19:09:53.541257 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.virt.hardware [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129368) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 19:09:53.550248 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:53.550867 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:53.552002 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:53.552754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:53.574639 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 19:09:53.578915 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.quota [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Getting quotas for user 4f7e62d82d054b98bd22dc6958577a74 and project 7041552fa8cc4a11ae098f1d2a16e359. Resources: {'ram', 'instances', 'cores'} {{(pid=129368) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 19:09:53.639530 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Going to run 1 instances... {{(pid=129368) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 19:09:53.641737 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='028bc371-199a-4cf0-b154-1cac6a82960e',volume_size=None,volume_type=None)] {{(pid=129368) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 19:09:53.772562 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-91cf8adf-ec14-460f-99e2-e7905b81e000 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.842864 Aug 03 19:09:53.773484 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 586/1187] 10.222.0.69 () {60 vars in 1147 bytes} [Wed Aug 3 19:09:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 19:09:53.784787 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d3913ca0-e799-491f-a6d2-0d5a20345831 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:53.785404 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d3913ca0-e799-491f-a6d2-0d5a20345831 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:53.840044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-d3913ca0-e799-491f-a6d2-0d5a20345831 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:53.846744 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d3913ca0-e799-491f-a6d2-0d5a20345831 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1094 microversion: 2.1 time: 0.066057 Aug 03 19:09:53.847309 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 602/1188] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:53 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:54.477660 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ade86869-27b0-460b-beeb-c2cd27efd765 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9f12280>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:54.505674 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-ade86869-27b0-460b-beeb-c2cd27efd765 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] HTTP exception thrown: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ade86869-27b0-460b-beeb-c2cd27efd765 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Request method failure captured: Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a HTTP/1.1 Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sfxuqCSYf9_M1SIhCbbvkkSUBM3q_zgSFh3GKfwzdEljO3FH5j-TpUwN-OIg9gYmS-o2zPLv6duWckPI67XheeZvZGsFUOXgpUZKr2AjC1-9gFpZ79PDFDrXJ7BrgkiSSJ0H18Y0qyaa3A8---Nx9XjSkOdwilXgDZFNmuxNBzkatQ Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:09:54.508987 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: a23b8f68e3094dac80d03274158dec15 Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '47598fb5-5fbd-4622-b27c-bcdf710a1b4a'} Aug 03 19:09:54.510850 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. (HTTP 404) (Request-ID: req-a47ec116-643c-4dac-a4a3-45b0895f79b4) Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.512119 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:09:54.513622 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 19:09:54.514959 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-ade86869-27b0-460b-beeb-c2cd27efd765 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Returning 404 to user: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-ade86869-27b0-460b-beeb-c2cd27efd765 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 404 len: 109 microversion: 2.1 time: 0.036790 Aug 03 19:09:54.516331 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 587/1189] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:54 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:09:54.525086 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-88cf1c7d-8b01-4fbd-8fb7-31c5034d52cb tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdace8710d0>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:54.552803 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-88cf1c7d-8b01-4fbd-8fb7-31c5034d52cb tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] HTTP exception thrown: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-88cf1c7d-8b01-4fbd-8fb7-31c5034d52cb tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Request method failure captured: Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: DELETE /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a HTTP/1.1 Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6sfxuqCSYf9_M1SIhCbbvkkSUBM3q_zgSFh3GKfwzdEljO3FH5j-TpUwN-OIg9gYmS-o2zPLv6duWckPI67XheeZvZGsFUOXgpUZKr2AjC1-9gFpZ79PDFDrXJ7BrgkiSSJ0H18Y0qyaa3A8---Nx9XjSkOdwilXgDZFNmuxNBzkatQ Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:09:54.555527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: a23b8f68e3094dac80d03274158dec15 Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '47598fb5-5fbd-4622-b27c-bcdf710a1b4a'} Aug 03 19:09:54.557183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. (HTTP 404) (Request-ID: req-d8704477-d5b2-4cc2-9ceb-80b9426e99a0) Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.558183 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 19:09:54.559702 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 19:09:54.561130 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-88cf1c7d-8b01-4fbd-8fb7-31c5034d52cb tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Returning 404 to user: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-88cf1c7d-8b01-4fbd-8fb7-31c5034d52cb tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 404 len: 109 microversion: 2.1 time: 0.035842 Aug 03 19:09:54.562604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 603/1190] 10.222.0.69 () {58 vars in 1248 bytes} [Wed Aug 3 19:09:54 2022] DELETE /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:54.565586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0722d768-88e0-4524-9e92-9da39bc545f4 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Calling method '.version_select at 0x7fdac9e83700>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:54.593417 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-0722d768-88e0-4524-9e92-9da39bc545f4 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] HTTP exception thrown: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0722d768-88e0-4524-9e92-9da39bc545f4 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Request method failure captured: Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a HTTP/1.1 Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6sfxuqCSYf9_M1SIhCbbvkkSUBM3q_zgSFh3GKfwzdEljO3FH5j-TpUwN-OIg9gYmS-o2zPLv6duWckPI67XheeZvZGsFUOXgpUZKr2AjC1-9gFpZ79PDFDrXJ7BrgkiSSJ0H18Y0qyaa3A8---Nx9XjSkOdwilXgDZFNmuxNBzkatQ Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:09:54.595384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7fbdbf49ea1541648ed6d22afdabf891"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 7fbdbf49ea1541648ed6d22afdabf891 Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321840342 Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: a23b8f68e3094dac80d03274158dec15 Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321840342-project Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': '47598fb5-5fbd-4622-b27c-bcdf710a1b4a'} Aug 03 19:09:54.597067 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. (HTTP 404) (Request-ID: req-6e8c2af1-1e4d-4752-aae7-579c9be981f3) Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.597974 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 19:09:54.599357 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 19:09:54.601019 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-0722d768-88e0-4524-9e92-9da39bc545f4 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] Returning 404 to user: Volume 47598fb5-5fbd-4622-b27c-bcdf710a1b4a could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-0722d768-88e0-4524-9e92-9da39bc545f4 tempest-VolumesSnapshotsTestJSON-321840342 tempest-VolumesSnapshotsTestJSON-321840342-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a" status: 404 len: 109 microversion: 2.1 time: 0.035275 Aug 03 19:09:54.602653 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 588/1191] 10.222.0.69 () {58 vars in 1245 bytes} [Wed Aug 3 19:09:54 2022] GET /compute/v2.1/os-volumes/47598fb5-5fbd-4622-b27c-bcdf710a1b4a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:09:54.871691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-391030a6-fbb2-482f-a564-5f5312495f7f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:54.872420 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-391030a6-fbb2-482f-a564-5f5312495f7f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:54.935054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-391030a6-fbb2-482f-a564-5f5312495f7f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:54.942608 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-391030a6-fbb2-482f-a564-5f5312495f7f tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1094 microversion: 2.1 time: 0.075835 Aug 03 19:09:54.943291 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 604/1192] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:54 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:55.964713 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e601762b-2689-4f78-9149-80f6ee45a8ab tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:55.967324 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e601762b-2689-4f78-9149-80f6ee45a8ab tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:56.031636 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e601762b-2689-4f78-9149-80f6ee45a8ab tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:56.042701 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e601762b-2689-4f78-9149-80f6ee45a8ab tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1094 microversion: 2.1 time: 0.082125 Aug 03 19:09:56.043479 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 589/1193] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:55 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:57.065507 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4c10ebbe-4894-494d-b70a-42e9dcba1273 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:57.066258 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4c10ebbe-4894-494d-b70a-42e9dcba1273 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:57.129607 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4c10ebbe-4894-494d-b70a-42e9dcba1273 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:57.138039 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4c10ebbe-4894-494d-b70a-42e9dcba1273 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1094 microversion: 2.1 time: 0.076489 Aug 03 19:09:57.138866 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 605/1194] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:57 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:58.159059 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:58.159686 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:58.167611 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:58.168352 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:58.169133 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:58.169771 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:58.248791 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:58.265888 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-4ae1a296-9fbf-40a0-a7d3-1df4530e2b98 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1210 microversion: 2.1 time: 0.110411 Aug 03 19:09:58.266826 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 590/1195] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:58 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:09:59.290570 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:09:59.291332 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:09:59.298351 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:59.298868 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:59.299728 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:59.300399 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:59.451501 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-ffcf8c84-f33c-4333-9421-e047b6711327 req-660f783d-481d-47dd-a25c-9d68536ff6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cf6d58-ebc7-4bc3-97b2-db1df1451f1c", "tag": "a764d590-6527-4793-895b-fda85819f437"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:09:59.465363 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-ffcf8c84-f33c-4333-9421-e047b6711327 req-660f783d-481d-47dd-a25c-9d68536ff6a1 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:09:59.466238 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-ffcf8c84-f33c-4333-9421-e047b6711327 req-660f783d-481d-47dd-a25c-9d68536ff6a1 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:09:59.478697 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-ffcf8c84-f33c-4333-9421-e047b6711327 req-660f783d-481d-47dd-a25c-9d68536ff6a1 service nova] Creating event network-changed:a764d590-6527-4793-895b-fda85819f437 for instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c on hv-cinder-85164 Aug 03 19:09:59.483816 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-ffcf8c84-f33c-4333-9421-e047b6711327 req-660f783d-481d-47dd-a25c-9d68536ff6a1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036401 Aug 03 19:09:59.485083 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 591/1196] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:09:59.532640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:09:59.541480 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-947d0e96-712d-4ac3-ab61-0e400b0700e8 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.256351 Aug 03 19:09:59.542155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 606/1197] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:09:59 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:00.564384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:00.565092 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:00.571981 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:00.572603 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:00.573492 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:00.573939 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:00.711830 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:00.719385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-1e068b15-b97b-4e16-86d3-150b12355199 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.160520 Aug 03 19:10:00.720402 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 592/1198] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:00 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:01.740625 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:01.741185 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:01.748255 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:01.748743 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:01.749514 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:01.749959 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:01.880146 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:01.888010 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-90425e0c-ad43-425d-af26-05dba04f4867 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.151354 Aug 03 19:10:01.888869 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 607/1199] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:01 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:02.908845 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:02.909467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:02.917208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:02.917667 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:02.918446 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:02.918887 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:03.056571 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:03.063925 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-73348510-b6b8-41ec-93f3-da5ee58f9346 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.158993 Aug 03 19:10:03.064518 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 593/1200] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:02 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:04.086819 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:04.087619 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:04.094327 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:04.094774 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:04.095532 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:04.095968 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:04.228302 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:04.235877 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-ffe05946-00f5-43c5-94ab-fa03f89e65e9 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.154525 Aug 03 19:10:04.236489 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 608/1201] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:04 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:05.258143 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:05.258773 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:05.260989 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=2 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:05.267756 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:05.268202 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:05.268994 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:05.269431 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:05.418680 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:05.426064 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-e11eb080-9687-4e81-8f30-baa280309f0b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.172848 Aug 03 19:10:05.426630 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 594/1202] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:05 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:06.447724 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:06.448307 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:06.454856 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:06.455328 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:06.456084 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:06.456552 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:06.590156 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:06.597558 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-df32768b-7ac3-4106-9745-9098b300b3eb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.154442 Aug 03 19:10:06.598122 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 609/1203] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:06 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:07.619411 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:07.620034 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:07.621958 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell0:SELECT=8 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:07.627920 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:07.628410 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:07.629190 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:07.629634 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:07.805502 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:07.813386 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-3c8d0929-a6cf-42bf-a127-dd86414369fb tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.198733 Aug 03 19:10:07.814219 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 595/1204] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:07 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:08.833752 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:08.836986 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:08.840346 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell0:SELECT=6 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:08.844742 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:08.845189 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:08.845950 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:08.846379 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:09.047134 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:09.057381 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-4c3d5e3f-f54f-4abd-9e91-d59ab93726b4 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.227085 Aug 03 19:10:09.058285 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 610/1205] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:08 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:10.079066 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:10.079715 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:10.087221 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:10.087688 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:10.088515 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:10.088961 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:10.234655 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:10.242876 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f10c40da-f480-43d3-81f1-a748029c94b1 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.167674 Aug 03 19:10:10.243714 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 596/1206] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:10 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:10.978651 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-5044a543-be01-4e6b-a4cd-ebf820bc0652 req-1108b13c-ed07-4fbf-9989-c0a26b208d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cf6d58-ebc7-4bc3-97b2-db1df1451f1c", "name": "network-vif-plugged", "status": "completed", "tag": "a764d590-6527-4793-895b-fda85819f437"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:10.990044 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-5044a543-be01-4e6b-a4cd-ebf820bc0652 req-1108b13c-ed07-4fbf-9989-c0a26b208d8b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:10.990831 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-5044a543-be01-4e6b-a4cd-ebf820bc0652 req-1108b13c-ed07-4fbf-9989-c0a26b208d8b service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:11.004500 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-5044a543-be01-4e6b-a4cd-ebf820bc0652 req-1108b13c-ed07-4fbf-9989-c0a26b208d8b service nova] Creating event network-vif-plugged:a764d590-6527-4793-895b-fda85819f437 for instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c on hv-cinder-85164 Aug 03 19:10:11.011093 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-5044a543-be01-4e6b-a4cd-ebf820bc0652 req-1108b13c-ed07-4fbf-9989-c0a26b208d8b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036893 Aug 03 19:10:11.013565 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 611/1207] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:11.264926 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:11.265578 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:11.272110 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:11.273233 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:11.274023 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:11.274467 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:11.437649 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:11.446206 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-77d4fa74-2d62-4428-8902-5403e44bf362 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.185424 Aug 03 19:10:11.446860 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 597/1208] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:11 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 19:10:12.468233 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:12.469611 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:12.476606 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:12.477061 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:12.477837 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:12.478277 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:12.620032 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:12.627452 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-80c96473-9daf-4b8c-9bcc-a102f1dac42e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1265 microversion: 2.1 time: 0.163993 Aug 03 19:10:12.628013 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 612/1209] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:12 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:13.649400 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:13.650153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:13.656790 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:13.657374 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:13.658153 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:13.658505 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:13.802754 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:13.811173 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-a5336aa4-6b61-4562-b520-9a33a25af3be tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1453 microversion: 2.1 time: 0.166808 Aug 03 19:10:13.811731 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 598/1210] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:13 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:13.830732 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:10:13.831343 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:10:13.833711 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=27 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:13.840116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:13.840604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:13.841358 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:13.841788 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:13.977756 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:10:13.985221 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1940dac9-b96d-4929-bbfa-cb79208211f0 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1453 microversion: 2.1 time: 0.158325 Aug 03 19:10:13.985784 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 613/1211] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:10:13 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:10:16.132952 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-5768e544-c0bd-4b6e-917e-99e3d73c17e6 req-35285dfe-c8e3-4616-be9f-b022684373da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cf6d58-ebc7-4bc3-97b2-db1df1451f1c", "tag": "a764d590-6527-4793-895b-fda85819f437"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:10:16.138746 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:16.144243 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-5768e544-c0bd-4b6e-917e-99e3d73c17e6 req-35285dfe-c8e3-4616-be9f-b022684373da service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:10:16.144746 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-5768e544-c0bd-4b6e-917e-99e3d73c17e6 req-35285dfe-c8e3-4616-be9f-b022684373da service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:10:16.147711 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=53 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:10:16.160035 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-5768e544-c0bd-4b6e-917e-99e3d73c17e6 req-35285dfe-c8e3-4616-be9f-b022684373da service nova] Creating event network-changed:a764d590-6527-4793-895b-fda85819f437 for instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c on hv-cinder-85164 Aug 03 19:10:16.166976 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-5768e544-c0bd-4b6e-917e-99e3d73c17e6 req-35285dfe-c8e3-4616-be9f-b022684373da service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037564 Aug 03 19:10:16.168594 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 599/1212] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:10:26.161523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:10:26.162151 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 19:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:10:30.693162 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:10:30.693918 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 19:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:12:10.425303 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:12:10.425950 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Wed Aug 3 19:12:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:12:13.179804 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:12:13.180496 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Wed Aug 3 19:12:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:12:17.453624 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a973d65e-9bc3-4bb9-ab7c-0d2c967cb081] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 03 19:12:17.454175 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_api:SELECT=1 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:17.454888 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG dbcounter [-] [129369] Writing DB stats nova_cell1:SELECT=44 {{(pid=129369) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:17.456388 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e644b818-695e-4377-9de1-a6d9ee749031] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 19:12:17.457010 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_cell1:SELECT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:17.457739 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG dbcounter [-] [129368] Writing DB stats nova_api:SELECT=1 {{(pid=129368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 19:12:17.458950 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:17.459364 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:17.478749 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:17.479813 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:17.480614 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:17.481053 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:17.506582 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Going to try to terminate instance {{(pid=129369) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:12:17.590772 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-76f5c7e9-5ac1-4ec0-9bf4-27d37b7edc75 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "DELETE /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 204 len: 0 microversion: 2.1 time: 0.138883 Aug 03 19:12:17.592155 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 614/1213] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:12:17 2022] DELETE /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:12:17.600153 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:17.600913 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:17.607228 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:17.607678 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:17.608506 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:17.608945 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:17.609887 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-c1a5610e-55e7-4fc1-bdea-00668dd442ed req-3cb0c7e7-a6e1-4631-858b-fda9dd98dae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cf6d58-ebc7-4bc3-97b2-db1df1451f1c", "tag": "a764d590-6527-4793-895b-fda85819f437"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:17.622456 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c1a5610e-55e7-4fc1-bdea-00668dd442ed req-3cb0c7e7-a6e1-4631-858b-fda9dd98dae8 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:17.622999 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-c1a5610e-55e7-4fc1-bdea-00668dd442ed req-3cb0c7e7-a6e1-4631-858b-fda9dd98dae8 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:17.634256 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-c1a5610e-55e7-4fc1-bdea-00668dd442ed req-3cb0c7e7-a6e1-4631-858b-fda9dd98dae8 service nova] Creating event network-changed:a764d590-6527-4793-895b-fda85819f437 for instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c on hv-cinder-85164 Aug 03 19:12:17.640740 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-c1a5610e-55e7-4fc1-bdea-00668dd442ed req-3cb0c7e7-a6e1-4631-858b-fda9dd98dae8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185958 Aug 03 19:12:17.641713 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 600/1214] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:17.808196 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:17.816115 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-eff6eeb5-633b-40c7-8cb7-c4248cb7b324 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1578 microversion: 2.1 time: 0.219892 Aug 03 19:12:17.816454 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 615/1215] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:17 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:18.839155 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:18.839766 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:18.846937 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:18.847377 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:18.848132 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:18.848602 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:18.853910 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] [e644b818-695e-4377-9de1-a6d9ee749031] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43514. Aug 03 19:12:19.133599 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:19.143275 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-b842be85-ae0e-428c-af88-3e990234be34 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1578 microversion: 2.1 time: 0.309611 Aug 03 19:12:19.156317 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 601/1216] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:18 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1578 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:20.167882 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:20.168453 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:20.176394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:20.176843 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:20.177610 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:20.178074 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:20.198666 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] [a973d65e-9bc3-4bb9-ab7c-0d2c967cb081] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 43520. Aug 03 19:12:20.321895 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:20.334737 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-50e9f9df-8652-4855-8eba-7cd83534f710 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 200 len: 1459 microversion: 2.1 time: 0.171391 Aug 03 19:12:20.346346 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 616/1217] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:20 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:20.388070 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-180e6992-693d-4831-aa05-fb28da53798d req-25e758d1-1dcc-4d2a-9583-dbbd6c42f93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cf6d58-ebc7-4bc3-97b2-db1df1451f1c", "name": "network-vif-deleted", "tag": "a764d590-6527-4793-895b-fda85819f437"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:20.397943 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-180e6992-693d-4831-aa05-fb28da53798d req-25e758d1-1dcc-4d2a-9583-dbbd6c42f93c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:20.398385 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-180e6992-693d-4831-aa05-fb28da53798d req-25e758d1-1dcc-4d2a-9583-dbbd6c42f93c service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:20.409981 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-180e6992-693d-4831-aa05-fb28da53798d req-25e758d1-1dcc-4d2a-9583-dbbd6c42f93c service nova] Creating event network-vif-deleted:a764d590-6527-4793-895b-fda85819f437 for instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c on hv-cinder-85164 Aug 03 19:12:20.414913 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-180e6992-693d-4831-aa05-fb28da53798d req-25e758d1-1dcc-4d2a-9583-dbbd6c42f93c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030935 Aug 03 19:12:20.415529 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 602/1218] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:21.358714 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:21.359448 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:21.365939 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:21.366395 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:21.367166 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:21.367604 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:21.382447 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] HTTP exception thrown: Instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c could not be found. Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Request method failure captured: Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c HTTP/1.1 Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6safPhpzqpT1Mhx9TYZkEsnEhu_y_ckw1hiX0KC5jsbqeqqokO5S5F66ugDhIR8kE4LhPJUro-K6aVQdu1lnpZ9R4X-IRthRA5V6Jw8AocZ3SAJHiKO8tfASB8DZ2ZDVX_BFi1WNHR9kZGH5_pMUPhfVaK9ATuUjtEuLNfHhi1Qf6o0 Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:12:21.384121 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 4f7e62d82d054b98bd22dc6958577a74 Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c could not be found. Aug 03 19:12:21.386544 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': '52cf6d58-ebc7-4bc3-97b2-db1df1451f1c'} Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c could not be found. Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:21.388016 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c could not be found. Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c could not be found. Aug 03 19:12:21.389879 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:21.391553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Returning 404 to user: Instance 52cf6d58-ebc7-4bc3-97b2-db1df1451f1c could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:21.391553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-2d3b21a8-4249-4cee-895b-34ffad213d02 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c" status: 404 len: 111 microversion: 2.1 time: 0.031312 Aug 03 19:12:21.391553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 617/1219] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:21 2022] GET /compute/v2.1/servers/52cf6d58-ebc7-4bc3-97b2-db1df1451f1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:24.479098 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:24.479842 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:24.481278 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [req-6dfcdd0c-ae6e-4fb2-8dde-26714a362f1a req-60d7e669-5d44-4e72-b5ec-7603a2ef0094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b918f50e-0448-47fd-a9f8-6008adb199dc", "tag": "2162daa0-4dcf-43ce-ab7b-8f57a96c54bb"}]} {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:24.486743 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:24.488729 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:24.489907 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:24.490414 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:24.492574 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-6dfcdd0c-ae6e-4fb2-8dde-26714a362f1a req-60d7e669-5d44-4e72-b5ec-7603a2ef0094 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:24.493017 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [req-6dfcdd0c-ae6e-4fb2-8dde-26714a362f1a req-60d7e669-5d44-4e72-b5ec-7603a2ef0094 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:24.505111 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.compute.server_external_events [req-6dfcdd0c-ae6e-4fb2-8dde-26714a362f1a req-60d7e669-5d44-4e72-b5ec-7603a2ef0094 service nova] Creating event network-changed:2162daa0-4dcf-43ce-ab7b-8f57a96c54bb for instance b918f50e-0448-47fd-a9f8-6008adb199dc on hv-cinder-85164 Aug 03 19:12:24.510646 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [req-6dfcdd0c-ae6e-4fb2-8dde-26714a362f1a req-60d7e669-5d44-4e72-b5ec-7603a2ef0094 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032472 Aug 03 19:12:24.511697 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 618/1220] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 19:12:24.519384 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Going to try to terminate instance {{(pid=129368) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 19:12:24.603565 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-59ef9274-6e84-417c-ba7c-0e13de314a8d tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 204 len: 0 microversion: 2.1 time: 0.128502 Aug 03 19:12:24.609670 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 603/1221] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:12:24 2022] DELETE /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 19:12:24.615442 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:24.616145 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:24.622707 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:24.623457 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:24.624229 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:24.624691 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:24.772582 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:24.780952 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-b9d24b64-d361-4f44-b622-9403909c523b tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1577 microversion: 2.1 time: 0.169843 Aug 03 19:12:24.781527 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 619/1222] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:24 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:25.803037 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:25.803800 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:25.810274 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:25.810749 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:25.811489 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:25.811931 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:25.957898 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.policy [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129368) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:25.967248 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-f2869f1f-8ec8-499f-bf92-b23c5b29447c tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1577 microversion: 2.1 time: 0.168386 Aug 03 19:12:25.968260 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 604/1223] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:25 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:26.988735 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:26.989389 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:26.996600 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:26.997054 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:26.997822 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:26.998284 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:27.137963 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.policy [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7e62d82d054b98bd22dc6958577a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7041552fa8cc4a11ae098f1d2a16e359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129369) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 19:12:27.145919 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-1207a465-11ad-40c4-82d0-59aacbb0272a tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 200 len: 1458 microversion: 2.1 time: 0.161185 Aug 03 19:12:27.146523 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 620/1224] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:26 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 1458 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 19:12:27.164166 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [req-f3012b27-f7e3-47cd-846d-ca5aa3d073f0 req-ee7bfd40-8fc3-4bb6-93aa-a04f1e5ce0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b918f50e-0448-47fd-a9f8-6008adb199dc", "name": "network-vif-deleted", "tag": "2162daa0-4dcf-43ce-ab7b-8f57a96c54bb"}]} {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 19:12:27.176072 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f3012b27-f7e3-47cd-846d-ca5aa3d073f0 req-ee7bfd40-8fc3-4bb6-93aa-a04f1e5ce0a0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:27.176550 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [req-f3012b27-f7e3-47cd-846d-ca5aa3d073f0 req-ee7bfd40-8fc3-4bb6-93aa-a04f1e5ce0a0 service nova] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:27.189389 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.compute.server_external_events [req-f3012b27-f7e3-47cd-846d-ca5aa3d073f0 req-ee7bfd40-8fc3-4bb6-93aa-a04f1e5ce0a0 service nova] Creating event network-vif-deleted:2162daa0-4dcf-43ce-ab7b-8f57a96c54bb for instance b918f50e-0448-47fd-a9f8-6008adb199dc on hv-cinder-85164 Aug 03 19:12:27.194601 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [req-f3012b27-f7e3-47cd-846d-ca5aa3d073f0 req-ee7bfd40-8fc3-4bb6-93aa-a04f1e5ce0a0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033943 Aug 03 19:12:27.195312 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 605/1225] 10.222.0.69 () {64 vars in 1317 bytes} [Wed Aug 3 19:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 19:12:28.167582 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:28.168215 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b918f50e-0448-47fd-a9f8-6008adb199dc] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:28.174850 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:28.175306 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:28.176076 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:28.176553 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:28.189875 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] HTTP exception thrown: Instance b918f50e-0448-47fd-a9f8-6008adb199dc could not be found. Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Request method failure captured: Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc HTTP/1.1 Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6safPhpzqpT1Mhx9TYZkEsnEhu_y_ckw1hiX0KC5jsbqeqqokO5S5F66ugDhIR8kE4LhPJUro-K6aVQdu1lnpZ9R4X-IRthRA5V6Jw8AocZ3SAJHiKO8tfASB8DZ2ZDVX_BFi1WNHR9kZGH5_pMUPhfVaK9ATuUjtEuLNfHhi1Qf6o0 Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:12:28.191515 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 4f7e62d82d054b98bd22dc6958577a74 Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance b918f50e-0448-47fd-a9f8-6008adb199dc could not be found. Aug 03 19:12:28.193316 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'b918f50e-0448-47fd-a9f8-6008adb199dc'} Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b918f50e-0448-47fd-a9f8-6008adb199dc could not be found. Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:28.194496 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b918f50e-0448-47fd-a9f8-6008adb199dc could not be found. Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b918f50e-0448-47fd-a9f8-6008adb199dc could not be found. Aug 03 19:12:28.196116 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.198446 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Returning 404 to user: Instance b918f50e-0448-47fd-a9f8-6008adb199dc could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:28.198446 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-a2450f15-a400-4ff2-a6b7-f1669b3d2809 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc" status: 404 len: 111 microversion: 2.1 time: 0.029586 Aug 03 19:12:28.198446 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 621/1226] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:28 2022] GET /compute/v2.1/servers/b918f50e-0448-47fd-a9f8-6008adb199dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 19:12:28.657171 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:28.658001 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.compute.api [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129368) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:28.663965 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:28.664458 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:28.665230 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:28.665671 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG oslo_concurrency.lockutils [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129368) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:28.678862 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.wsgi [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] HTTP exception thrown: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Request method failure captured: Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: request: DELETE /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 HTTP/1.1 Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept: application/json Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Accept-Encoding: identity Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Connection: close Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Length: 0 Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Content-Type: application/json Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Host: 10.222.0.69 Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Openstack-System-Scope: None Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Auth-Token: gAAAAABi6safPhpzqpT1Mhx9TYZkEsnEhu_y_ckw1hiX0KC5jsbqeqqokO5S5F66ugDhIR8kE4LhPJUro-K6aVQdu1lnpZ9R4X-IRthRA5V6Jw8AocZ3SAJHiKO8tfASB8DZ2ZDVX_BFi1WNHR9kZGH5_pMUPhfVaK9ATuUjtEuLNfHhi1Qf6o0 Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Id: None Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Domain-Name: None Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Identity-Status: Confirmed Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Is-Admin-Project: True Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Id: default Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Domain-Name: Default Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Project-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Role: member,reader Aug 03 19:12:28.680542 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Roles: member,reader Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-Tenant-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Id: default Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Domain-Name: Default Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Id: 4f7e62d82d054b98bd22dc6958577a74 Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: X-User-Name: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: method: > Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: exception: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.683250 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: action_args: {'id': 'b2808354-602d-46bd-8f4b-1106aee02ad8'} Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:28.684498 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.686208 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.687841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Returning 404 to user: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. {{(pid=129368) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:28.687841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-780b56a5-1fd9-4a8a-990d-30f1893b521e tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 404 len: 111 microversion: 2.1 time: 0.029675 Aug 03 19:12:28.687841 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 606/1227] 10.222.0.69 () {58 vars in 1239 bytes} [Wed Aug 3 19:12:28 2022] DELETE /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:12:28.692684 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '>' {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:28.693387 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.compute.api [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] [instance: b2808354-602d-46bd-8f4b-1106aee02ad8] Fetching instance by UUID {{(pid=129369) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 19:12:28.700025 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:28.700626 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:28.701990 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 19:12:28.702807 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG oslo_concurrency.lockutils [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Lock "bb8cd58f-50d6-42f2-8d04-20e0e2c543f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129369) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 19:12:28.718281 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.wsgi [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] HTTP exception thrown: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Request method failure captured: Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: request: GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 HTTP/1.1 Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept: application/json Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Accept-Encoding: identity Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Connection: close Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Length: 0 Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Content-Type: application/json Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Host: 10.222.0.69 Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Openstack-System-Scope: None Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: User-Agent: python-urllib3/1.26.11 Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Auth-Token: gAAAAABi6safPhpzqpT1Mhx9TYZkEsnEhu_y_ckw1hiX0KC5jsbqeqqokO5S5F66ugDhIR8kE4LhPJUro-K6aVQdu1lnpZ9R4X-IRthRA5V6Jw8AocZ3SAJHiKO8tfASB8DZ2ZDVX_BFi1WNHR9kZGH5_pMUPhfVaK9ATuUjtEuLNfHhi1Qf6o0 Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Id: None Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Domain-Name: None Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Identity-Status: Confirmed Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Is-Admin-Project: True Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Id: default Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Domain-Name: Default Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Project-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Role: member,reader Aug 03 19:12:28.719815 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Roles: member,reader Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.69:8080", "publicURL": "http://10.222.0.69:8080/v1/AUTH_7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/7041552fa8cc4a11ae098f1d2a16e359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}] Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Id: 7041552fa8cc4a11ae098f1d2a16e359 Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-Tenant-Name: tempest-TestVolumeBootPattern-444889007 Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Id: default Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Domain-Name: Default Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Id: 4f7e62d82d054b98bd22dc6958577a74 Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: X-User-Name: tempest-TestVolumeBootPattern-444889007-project Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: method: > Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: exception: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.721709 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: action_args: {'id': 'b2808354-602d-46bd-8f4b-1106aee02ad8'} Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: {{(pid=129369) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 19:12:28.722601 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. Aug 03 19:12:28.724048 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: ERROR nova.api.openstack.wsgi Aug 03 19:12:28.725340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: DEBUG nova.api.openstack.wsgi [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Returning 404 to user: Instance b2808354-602d-46bd-8f4b-1106aee02ad8 could not be found. {{(pid=129369) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 19:12:28.725340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO nova.api.openstack.requestlog [None req-d8c0a5a0-7d76-4909-9623-50062cc5fccd tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8" status: 404 len: 111 microversion: 2.1 time: 0.033824 Aug 03 19:12:28.725340 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: [pid: 129369|app: 0|req: 622/1228] 10.222.0.69 () {58 vars in 1236 bytes} [Wed Aug 3 19:12:28 2022] GET /compute/v2.1/servers/b2808354-602d-46bd-8f4b-1106aee02ad8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 19:12:30.044752 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: DEBUG nova.api.openstack.wsgi [None req-514b311b-585a-42eb-bd81-93775cdf8056 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] Calling method '.version_select at 0x7fdaca034790>' {{(pid=129368) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 19:12:30.067515 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO nova.api.openstack.requestlog [None req-514b311b-585a-42eb-bd81-93775cdf8056 tempest-TestVolumeBootPattern-444889007 tempest-TestVolumeBootPattern-444889007-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-631434978" status: 202 len: 0 microversion: 2.1 time: 0.027276 Aug 03 19:12:30.068095 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: [pid: 129368|app: 0|req: 607/1229] 10.222.0.69 () {58 vars in 1260 bytes} [Wed Aug 3 19:12:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-631434978 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 19:13:46.172394 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:13:46.173009 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 19:13:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:13:50.701738 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:13:50.702463 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 19:13:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:15:30.435197 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:15:30.435801 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Wed Aug 3 19:15:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:15:33.191586 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:15:33.192224 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Wed Aug 3 19:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:15:41.744658 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:15:41.745380 dv-cinder-851640-2-iscsi devstack@n-api.service[129368]: Wed Aug 3 19:15:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:17:06.181780 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:17:06.182406 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 19:17:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:17:10.710159 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:17:10.710711 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 19:17:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 19:17:25.385640 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 19:17:25.386398 dv-cinder-851640-2-iscsi devstack@n-api.service[129369]: Wed Aug 3 19:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!